2023-10-06T03:40:18.055 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T03:40:18.055 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230 --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/orig.config.yaml 2023-10-06T03:40:18.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:40:18.181 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} email: yweinste@redhat.com first_in_suite: false job_id: '7412230' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: disabled: true install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 kclient: disabled: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - workunit: clients: client.0: - fs/test_python.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T03:40:18.182 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T03:40:18.182 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T03:40:18.183 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T03:40:18.184 INFO:teuthology.task.internal:Checking packages... 2023-10-06T03:40:18.208 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T03:40:18.208 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T03:40:18.208 INFO:teuthology.packaging:ref: None 2023-10-06T03:40:18.209 INFO:teuthology.packaging:tag: None 2023-10-06T03:40:18.209 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T03:40:18.209 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:40:18.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T03:40:18.348 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:40:18.348 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T03:40:18.354 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T03:40:18.354 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T03:40:18.373 INFO:teuthology.task.internal:Saving configuration 2023-10-06T03:40:18.389 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T03:40:18.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:40:18.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:34:03.905062', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T03:40:18.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:34:03.903335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-06T03:40:18.443 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T03:40:18.449 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-06T03:40:18.449 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-06T03:40:18.449 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T03:40:18.517 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c6576b040>, signals=[15]) 2023-10-06T03:40:18.518 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T03:40:18.524 INFO:teuthology.task.internal:Opening connections... 2023-10-06T03:40:18.524 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:40:18.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:40:18.574 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:40:18.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:40:18.621 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T03:40:18.628 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-06T03:40:18.659 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-06T03:40:18.659 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-06T03:40:18.711 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T03:40:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T03:40:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T03:40:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T03:40:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-06T03:40:18.712 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-06T03:40:18.713 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-06T03:40:18.739 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-10-06T03:40:18.746 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-10-06T03:40:18.746 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-06T03:40:18.753 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-06T03:40:18.754 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2023-10-06T03:40:18.754 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2023-10-06T03:40:18.754 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-10-06T03:40:18.772 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T03:40:18.781 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T03:40:18.785 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T03:40:18.785 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:40:18.788 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2023-10-06T03:40:18.793 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T03:40:18.799 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T03:40:18.799 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:40:18.801 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2023-10-06T03:40:18.881 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T03:40:18.941 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T03:40:18.955 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T03:40:18.955 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T03:40:18.956 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:40:18.956 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T03:40:18.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:40:18.962 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-06T03:40:18.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:40:18.963 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2023-10-06T03:40:18.969 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-124-generic 2023-10-06T03:40:18.969 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.4.0-124-generic 2023-10-06T03:40:18.969 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2023-10-06T03:40:18.970 INFO:teuthology.orchestra.run.smithi105.stdout:5.4.0-124-generic 2023-10-06T03:40:18.970 INFO:teuthology.task.kernel:Running kernel on smithi105: 5.4.0-124-generic 2023-10-06T03:40:18.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get clean 2023-10-06T03:40:19.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2023-10-06T03:40:19.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-10-06T03:40:19.262 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T03:40:19.379 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:40:19.417 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:40:19.417 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-06T03:40:19.461 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T03:40:19.475 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-06T03:40:19.569 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T03:40:19.686 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T03:40:19.695 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T03:40:19.699 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T03:40:19.699 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T03:40:19.699 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T03:40:19.715 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T03:40:19.717 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T03:40:19.717 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T03:40:19.725 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T03:40:19.727 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T03:40:19.729 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T03:40:19.730 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T03:40:19.731 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T03:40:19.731 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T03:40:19.747 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T03:40:19.804 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T03:40:19.820 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-06T03:40:19.894 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-06T03:40:19.947 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T03:40:20.038 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T03:40:20.194 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-06T03:40:20.245 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-06T03:40:20.358 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T03:40:20.370 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T03:40:20.371 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T03:40:20.432 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T03:40:20.433 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T03:40:20.433 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-06T03:40:20.448 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-06T03:40:20.448 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-06T03:40:20.452 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T03:40:20.503 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-06T03:40:20.516 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-06T03:40:20.516 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-06T03:40:20.520 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-06T03:40:20.522 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T03:40:20.523 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-06T03:40:20.529 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-06T03:40:20.530 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-06T03:40:20.543 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-06T03:40:20.606 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-06T03:40:20.606 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-06T03:40:20.612 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-06T03:40:20.616 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T03:40:20.733 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-06T03:40:20.776 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-06T03:40:21.149 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-06T03:40:21.155 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-06T03:40:21.157 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-06T03:40:21.165 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-06T03:40:21.167 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-06T03:40:21.251 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T03:40:21.290 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T03:40:21.303 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T03:40:21.305 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T03:40:21.306 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T03:40:21.307 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T03:40:21.308 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T03:40:21.308 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T03:40:21.334 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T03:40:21.336 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T03:40:21.413 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-06T03:40:21.451 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-06T03:40:21.462 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-06T03:40:21.464 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-06T03:40:21.465 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-06T03:40:21.465 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-06T03:40:21.466 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-06T03:40:21.467 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-06T03:40:21.494 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-06T03:40:21.494 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-06T03:40:21.500 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T03:40:21.657 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T03:40:21.683 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-06T03:40:21.705 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T03:40:21.820 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-06T03:40:21.871 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-06T03:40:23.795 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 17.6 MB in 3s (6,877 kB/s) 2023-10-06T03:40:24.377 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 17.6 MB in 3s (5,587 kB/s) 2023-10-06T03:40:25.250 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:40:25.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T03:40:25.349 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:40:25.553 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T03:40:25.554 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T03:40:25.744 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-10-06T03:40:25.744 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T03:40:25.744 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T03:40:25.744 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T03:40:25.745 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-10-06T03:40:25.745 INFO:teuthology.orchestra.run.smithi057.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T03:40:25.745 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2023-10-06T03:40:25.745 INFO:teuthology.orchestra.run.smithi057.stdout: thermald 2023-10-06T03:40:25.800 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-10-06T03:40:25.801 INFO:teuthology.orchestra.run.smithi057.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T03:40:25.801 INFO:teuthology.orchestra.run.smithi057.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T03:40:25.801 INFO:teuthology.orchestra.run.smithi057.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T03:40:25.802 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-10-06T03:40:25.802 INFO:teuthology.orchestra.run.smithi057.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T03:40:25.859 INFO:teuthology.orchestra.run.smithi057.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T03:40:25.860 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 77.0 MB of archives. 2023-10-06T03:40:25.860 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T03:40:25.860 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T03:40:25.879 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:40:25.904 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T03:40:25.994 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:40:26.192 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T03:40:26.194 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T03:40:26.195 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T03:40:26.286 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T03:40:26.385 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2023-10-06T03:40:26.385 INFO:teuthology.orchestra.run.smithi105.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T03:40:26.385 INFO:teuthology.orchestra.run.smithi105.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-06T03:40:26.385 INFO:teuthology.orchestra.run.smithi105.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-06T03:40:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2023-10-06T03:40:26.386 INFO:teuthology.orchestra.run.smithi105.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-06T03:40:26.387 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2023-10-06T03:40:26.387 INFO:teuthology.orchestra.run.smithi105.stdout: thermald 2023-10-06T03:40:26.450 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2023-10-06T03:40:26.450 INFO:teuthology.orchestra.run.smithi105.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-06T03:40:26.450 INFO:teuthology.orchestra.run.smithi105.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-06T03:40:26.451 INFO:teuthology.orchestra.run.smithi105.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-06T03:40:26.452 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2023-10-06T03:40:26.452 INFO:teuthology.orchestra.run.smithi105.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-06T03:40:26.635 INFO:teuthology.orchestra.run.smithi105.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T03:40:26.635 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 77.0 MB of archives. 2023-10-06T03:40:26.635 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-06T03:40:26.635 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-06T03:40:26.746 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T03:40:26.747 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T03:40:26.748 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T03:40:26.840 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T03:40:26.851 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T03:40:27.553 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 77.0 MB in 1s (74.0 MB/s) 2023-10-06T03:40:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T03:40:27.787 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-06T03:40:28.097 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-06T03:40:29.410 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-06T03:40:29.411 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-06T03:40:29.411 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-06T03:40:29.523 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T03:40:29.529 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:29.651 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-06T03:40:30.388 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-06T03:40:31.084 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 77.0 MB in 4s (19.6 MB/s) 2023-10-06T03:40:31.278 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-06T03:40:31.827 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T03:40:31.844 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:31.957 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:32.999 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-06T03:40:33.004 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:33.098 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T03:40:33.111 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:33.125 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:33.147 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:35.117 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-06T03:40:35.130 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:35.246 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:36.387 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-06T03:40:36.401 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:36.445 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:37.982 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:38.107 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:38.585 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:38.714 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:39.074 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T03:40:39.089 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T03:40:39.131 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T03:40:41.293 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:41.417 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:41.769 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:41.904 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:42.266 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-06T03:40:42.278 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-06T03:40:42.323 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T03:40:44.782 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T03:40:44.806 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:44.865 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:47.881 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-06T03:40:47.902 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-06T03:40:47.947 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:48.791 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:48.913 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:49.252 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T03:40:49.400 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:49.526 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:50.697 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-06T03:40:50.811 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:50.841 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-06T03:40:51.184 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-06T03:40:51.295 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:51.455 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:51.995 INFO:teuthology.orchestra.run.smithi057.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:40:51.995 INFO:teuthology.orchestra.run.smithi057.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T03:40:52.147 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T03:40:52.289 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:52.707 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T03:40:53.873 INFO:teuthology.orchestra.run.smithi105.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:40:53.873 INFO:teuthology.orchestra.run.smithi105.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-06T03:40:53.992 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T03:40:54.009 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-06T03:40:54.143 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:54.151 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:54.219 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T03:40:54.219 INFO:teuthology.orchestra.run.smithi057.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:40:56.178 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-06T03:40:57.265 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-06T03:40:57.392 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-06T03:40:57.485 INFO:teuthology.orchestra.run.smithi105.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-06T03:40:57.485 INFO:teuthology.orchestra.run.smithi105.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:41:17.083 INFO:teuthology.orchestra.run.smithi057.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T03:41:17.083 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub' 2023-10-06T03:41:17.094 INFO:teuthology.orchestra.run.smithi057.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T03:41:17.112 INFO:teuthology.orchestra.run.smithi057.stdout:Generating grub configuration file ... 2023-10-06T03:41:17.457 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:41:17.481 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:41:17.860 INFO:teuthology.orchestra.run.smithi057.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T03:41:17.873 INFO:teuthology.orchestra.run.smithi057.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T03:41:19.436 INFO:teuthology.orchestra.run.smithi105.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-06T03:41:19.436 INFO:teuthology.orchestra.run.smithi105.stdout:Sourcing file `/etc/default/grub' 2023-10-06T03:41:19.450 INFO:teuthology.orchestra.run.smithi105.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T03:41:19.470 INFO:teuthology.orchestra.run.smithi105.stdout:Generating grub configuration file ... 2023-10-06T03:41:19.808 INFO:teuthology.orchestra.run.smithi105.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:41:19.829 INFO:teuthology.orchestra.run.smithi105.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:41:20.258 INFO:teuthology.orchestra.run.smithi105.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T03:41:20.269 INFO:teuthology.orchestra.run.smithi105.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T03:41:20.554 INFO:teuthology.orchestra.run.smithi057.stdout:done 2023-10-06T03:41:20.995 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 20 2023-10-06T03:41:21.038 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.4.0.164.161 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2023-10-06T03:41:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2023-10-06T03:41:21.039 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T03:41:21.040 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:41:21.040 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:41:21.040 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T03:41:21.040 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:41:21.040 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get clean 2023-10-06T03:41:21.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-10-06T03:41:21.270 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:41:21.270 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T03:41:21.275 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T03:41:21.292 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T03:41:22.951 INFO:teuthology.orchestra.run.smithi105.stdout:done 2023-10-06T03:41:23.063 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:41:23.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T03:41:23.160 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:41:23.346 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T03:41:23.347 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T03:41:23.387 DEBUG:teuthology.orchestra.run.smithi105:> dpkg -s linux-image-generic 2023-10-06T03:41:23.435 INFO:teuthology.orchestra.run.smithi105.stdout:Package: linux-image-generic 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Status: install ok installed 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Priority: optional 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Section: kernel 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Installed-Size: 20 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: amd64 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Source: linux-meta 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Version: 5.4.0.164.161 2023-10-06T03:41:23.436 INFO:teuthology.orchestra.run.smithi105.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T03:41:23.437 INFO:teuthology.orchestra.run.smithi105.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T03:41:23.437 INFO:teuthology.orchestra.run.smithi105.stdout:Recommends: thermald 2023-10-06T03:41:23.437 INFO:teuthology.orchestra.run.smithi105.stdout:Description: Generic Linux kernel image 2023-10-06T03:41:23.437 INFO:teuthology.orchestra.run.smithi105.stdout: This package will always depend on the latest generic kernel image 2023-10-06T03:41:23.437 INFO:teuthology.orchestra.run.smithi105.stdout: available. 2023-10-06T03:41:23.437 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-06T03:41:23.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T03:41:23.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T03:41:23.437 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T03:41:23.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi105.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T03:41:23.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get clean 2023-10-06T03:41:23.514 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2023-10-06T03:41:23.568 INFO:teuthology.orchestra.run.smithi057.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T03:41:23.568 INFO:teuthology.orchestra.run.smithi057.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T03:41:23.570 DEBUG:teuthology.orchestra.run.smithi057:> dpkg -s linux-image-generic 2023-10-06T03:41:23.592 INFO:teuthology.orchestra.run.smithi057.stdout:Package: linux-image-generic 2023-10-06T03:41:23.592 INFO:teuthology.orchestra.run.smithi057.stdout:Status: install ok installed 2023-10-06T03:41:23.592 INFO:teuthology.orchestra.run.smithi057.stdout:Priority: optional 2023-10-06T03:41:23.592 INFO:teuthology.orchestra.run.smithi057.stdout:Section: kernel 2023-10-06T03:41:23.592 INFO:teuthology.orchestra.run.smithi057.stdout:Installed-Size: 20 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: amd64 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Source: linux-meta 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Version: 5.4.0.164.161 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Recommends: thermald 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:Description: Generic Linux kernel image 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: This package will always depend on the latest generic kernel image 2023-10-06T03:41:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: available. 2023-10-06T03:41:23.594 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-10-06T03:41:23.598 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.jPTxkDhA6E 2023-10-06T03:41:23.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub/grub.cfg /tmp/tmp.jPTxkDhA6E 2023-10-06T03:41:23.649 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:41:23.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.jPTxkDhA6E 2023-10-06T03:41:23.657 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T03:41:23.677 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T03:41:23.701 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.jPTxkDhA6E is 9KB 2023-10-06T03:41:23.715 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.jPTxkDhA6E 2023-10-06T03:41:23.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T03:41:23.762 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T03:41:23.780 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:41:23.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T03:41:23.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T03:41:23.815 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T03:41:23.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo update-grub 2023-10-06T03:41:25.161 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub' 2023-10-06T03:41:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T03:41:25.183 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-10-06T03:41:25.386 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:41:25.411 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-06T03:41:25.444 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:41:25.456 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:41:25.482 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:41:25.658 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T03:41:25.659 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T03:41:25.830 INFO:teuthology.orchestra.run.smithi057.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T03:41:25.841 INFO:teuthology.orchestra.run.smithi057.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T03:41:25.866 INFO:teuthology.orchestra.run.smithi105.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-06T03:41:25.866 INFO:teuthology.orchestra.run.smithi105.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-06T03:41:25.868 DEBUG:teuthology.orchestra.run.smithi105:> dpkg -s linux-image-generic 2023-10-06T03:41:25.884 INFO:teuthology.orchestra.run.smithi105.stdout:Package: linux-image-generic 2023-10-06T03:41:25.884 INFO:teuthology.orchestra.run.smithi105.stdout:Status: install ok installed 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Priority: optional 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Section: kernel 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Installed-Size: 20 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Maintainer: Ubuntu Kernel Team 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: amd64 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Source: linux-meta 2023-10-06T03:41:25.885 INFO:teuthology.orchestra.run.smithi105.stdout:Version: 5.4.0.164.161 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout:Recommends: thermald 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout:Description: Generic Linux kernel image 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout: This package will always depend on the latest generic kernel image 2023-10-06T03:41:25.886 INFO:teuthology.orchestra.run.smithi105.stdout: available. 2023-10-06T03:41:25.887 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2023-10-06T03:41:25.891 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.9cs9M6wn0I 2023-10-06T03:41:25.891 DEBUG:teuthology.orchestra.run.smithi105:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9cs9M6wn0I 2023-10-06T03:41:25.949 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.9cs9M6wn0I 2023-10-06T03:41:25.988 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.9cs9M6wn0I is 9KB 2023-10-06T03:41:26.000 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.9cs9M6wn0I 2023-10-06T03:41:26.006 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-06T03:41:26.063 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:41:26.064 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-06T03:41:26.064 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-06T03:41:26.092 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-06T03:41:26.093 DEBUG:teuthology.orchestra.run.smithi105:> sudo update-grub 2023-10-06T03:41:27.416 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2023-10-06T03:41:27.424 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-06T03:41:27.438 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2023-10-06T03:41:27.514 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-10-06T03:41:27.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2023-10-06T03:41:27.721 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-06T03:41:27.733 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-06T03:41:28.102 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-06T03:41:28.109 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-06T03:41:29.734 INFO:teuthology.orchestra.run.smithi105.stderr:done 2023-10-06T03:41:29.736 DEBUG:teuthology.orchestra.run.smithi105:> sudo shutdown -r now 2023-10-06T03:41:57.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T03:41:57.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:41:57.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:41:59.746 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T03:41:59.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:41:59.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:42:15.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T03:42:24.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:42:24.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:42:27.998 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-06T03:42:34.362 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-06T03:42:40.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:42:40.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:42:43.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:42:43.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:43:01.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-10-06T03:43:13.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:43:13.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:43:13.983 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-06T03:43:14.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:43:14.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-06T03:43:14.554 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2023-10-06T03:43:14.561 INFO:teuthology.orchestra.run.smithi105.stdout:5.4.0-164-generic 2023-10-06T03:43:14.561 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T03:43:14.561 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:43:14.561 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T03:43:15.562 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T03:43:15.562 DEBUG:teuthology.orchestra.run.smithi105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T03:43:15.656 INFO:teuthology.orchestra.run.smithi105.stdout:ttyS1 2023-10-06T03:43:15.690 DEBUG:teuthology.parallel:result is None 2023-10-06T03:43:40.008 DEBUG:teuthology.orchestra.remote:timed out 2023-10-06T03:43:55.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:43:55.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:43:55.215 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-06T03:43:55.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:43:55.893 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-06T03:43:55.893 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-10-06T03:43:55.899 INFO:teuthology.orchestra.run.smithi057.stdout:5.4.0-164-generic 2023-10-06T03:43:55.899 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-06T03:43:55.899 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T03:43:55.899 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-06T03:43:56.900 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T03:43:56.900 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T03:43:57.001 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2023-10-06T03:43:57.036 DEBUG:teuthology.parallel:result is None 2023-10-06T03:43:57.037 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T03:43:57.044 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T03:43:57.045 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:43:57.047 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T03:43:57.054 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T03:43:57.062 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T03:43:57.071 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T03:43:57.071 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:43:57.073 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T03:43:57.120 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T03:43:57.129 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T03:43:57.130 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:43:57.132 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T03:43:57.148 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:43:57.154 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:43:57.159 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:43:57.165 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T03:43:57.167 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T03:43:57.174 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T03:43:57.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:43:57.176 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T03:43:57.191 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T03:43:57.201 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T03:43:57.201 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:43:57.203 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T03:43:57.238 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:43:57.257 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:43:57.263 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:43:57.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:43:57.281 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T03:43:57.288 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T03:43:57.295 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:43:57.295 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T03:43:57.357 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-10-06T03:43:57.360 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2023-10-06T03:43:57.409 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T03:43:57.416 INFO:teuthology.task.internal:Starting timer... 2023-10-06T03:43:57.417 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T03:43:57.435 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T03:43:57.455 DEBUG:teuthology.task.selinux:Excluding smithi057: OS 'ubuntu' does not support SELinux 2023-10-06T03:43:57.455 DEBUG:teuthology.task.selinux:Excluding smithi105: OS 'ubuntu' does not support SELinux 2023-10-06T03:43:57.456 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T03:43:57.456 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-06T03:43:57.456 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T03:43:57.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T03:43:57.471 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T03:43:57.476 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T03:43:57.601 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T03:43:57.616 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T03:43:57.617 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T03:49:42.843 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2023-10-06T03:49:42.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:49:42.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:49:42.901 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-06T03:49:43.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-06T03:49:43.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:49:43.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:49:43.072 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-10-06T03:49:43.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-10-06T03:49:43.192 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T03:49:43.206 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T03:49:43.206 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:49:43.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:49:43.209 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:49:43.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:49:43.241 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T03:49:43.241 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Command line: ntpd -gq 2023-10-06T03:49:43.242 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: proto: precision = 0.120 usec (-23) 2023-10-06T03:49:43.243 INFO:teuthology.orchestra.run.smithi057.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T03:49:43.243 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T03:49:43.244 INFO:teuthology.orchestra.run.smithi057.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T03:49:43.245 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T03:49:43.245 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T03:49:43.245 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T03:49:43.245 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T03:49:43.246 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen normally on 3 ens1f0 172.21.15.57:123 2023-10-06T03:49:43.246 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen normally on 4 lo [::1]:123 2023-10-06T03:49:43.246 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1562%4]:123 2023-10-06T03:49:43.246 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:43 ntpd[22705]: Listening on routing socket on fd #22 for interface updates 2023-10-06T03:49:43.268 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-06T03:49:43.268 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Command line: ntpd -gq 2023-10-06T03:49:43.269 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: proto: precision = 0.172 usec (-22) 2023-10-06T03:49:43.269 INFO:teuthology.orchestra.run.smithi105.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T03:49:43.270 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-06T03:49:43.270 INFO:teuthology.orchestra.run.smithi105.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: restrict ::: KOD does nothing without LIMITED. 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen and drop on 0 v6wildcard [::]:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen normally on 2 lo 127.0.0.1:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen normally on 3 enp3s0f1 172.21.15.105:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen normally on 4 lo [::1]:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d429%5]:123 2023-10-06T03:49:43.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:43 ntpd[22871]: Listening on routing socket on fd #22 for interface updates 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:44.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:44 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:44.268 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:44.268 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:44.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:44.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:44.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:44.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:44 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:45.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:45 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:46.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:46 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:46.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:46.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:46.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:46.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:46.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:46.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:46.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:46.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:46 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:47.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.244 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.244 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:47.244 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:47 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:47.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:47.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:47.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:47.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:47 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:48.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:48.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:48 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:48.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:48.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:48 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:49.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:49.244 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:49 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:49.269 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:49 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:50.242 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:50.243 INFO:teuthology.orchestra.run.smithi057.stdout: 6 Oct 03:49:50 ntpd[22705]: ntpd: time slew +0.000844 s 2023-10-06T03:49:50.243 INFO:teuthology.orchestra.run.smithi057.stdout:ntpd: time slew +0.000844s 2023-10-06T03:49:50.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T03:49:50.243 INFO:teuthology.orchestra.run.smithi057.stderr: 6 Oct 03:49:50 ntpd[22705]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.270 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/rawstats.20231006: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/peerstats.20231006: Permission denied 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stdout: 6 Oct 03:49:50 ntpd[22871]: ntpd: time slew +0.004044 s 2023-10-06T03:49:50.271 INFO:teuthology.orchestra.run.smithi105.stdout:ntpd: time slew +0.004044s 2023-10-06T03:49:50.272 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-06T03:49:50.272 INFO:teuthology.orchestra.run.smithi105.stderr: 6 Oct 03:49:50 ntpd[22871]: can't open /var/log/ntpstats/loopstats.20231006: Permission denied 2023-10-06T03:49:50.307 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:49:50.307 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-10-06T03:49:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.308 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.335 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:49:50.336 INFO:teuthology.run_tasks:Running task install... 2023-10-06T03:49:50.346 DEBUG:teuthology.task.install:project ceph 2023-10-06T03:49:50.346 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T03:49:50.346 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T03:49:50.346 INFO:teuthology.task.install:Using flavor: default 2023-10-06T03:49:50.352 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T03:49:50.352 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T03:49:50.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-key list | grep Ceph 2023-10-06T03:49:50.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-key list | grep Ceph 2023-10-06T03:49:50.455 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T03:49:50.458 INFO:teuthology.orchestra.run.smithi057.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-06T03:49:50.516 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T03:49:50.516 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T03:49:50.517 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T03:49:50.517 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T03:49:50.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:49:50.521 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-06T03:49:50.521 INFO:teuthology.orchestra.run.smithi057.stdout:uid [ unknown] Ceph.com (release key) 2023-10-06T03:49:50.522 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-06T03:49:50.522 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-10-06T03:49:50.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:49:50.739 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T03:49:50.739 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:49:50.744 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default/ 2023-10-06T03:49:50.744 INFO:teuthology.task.install.deb:Package version is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:49:50.844 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:49:50.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T03:49:50.850 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:49:50.850 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-06T03:49:50.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo apt-get update 2023-10-06T03:49:50.866 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2023-10-06T03:49:51.053 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T03:49:51.056 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:49:51.057 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T03:49:51.064 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T03:49:51.074 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T03:49:51.084 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T03:49:51.097 INFO:teuthology.orchestra.run.smithi057.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T03:49:51.107 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal InRelease 2023-10-06T03:49:51.129 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-06T03:49:51.130 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-06T03:49:51.130 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-06T03:49:51.130 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T03:49:51.152 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal Release.gpg 2023-10-06T03:49:51.174 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T03:49:51.177 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main i386 Packages [3,391 B] 2023-10-06T03:49:51.199 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-06T03:49:51.217 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-06T03:49:51.283 INFO:teuthology.orchestra.run.smithi057.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-06T03:49:51.712 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 28.4 kB in 1s (44.8 kB/s) 2023-10-06T03:49:51.799 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 28.4 kB in 1s (36.8 kB/s) 2023-10-06T03:49:52.742 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:49:52.768 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:49:52.838 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:49:52.877 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:49:52.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1274-g68e53a4a-1focal cephadm=17.2.6-1274-g68e53a4a-1focal ceph-mds=17.2.6-1274-g68e53a4a-1focal ceph-mgr=17.2.6-1274-g68e53a4a-1focal ceph-common=17.2.6-1274-g68e53a4a-1focal ceph-fuse=17.2.6-1274-g68e53a4a-1focal ceph-test=17.2.6-1274-g68e53a4a-1focal ceph-volume=17.2.6-1274-g68e53a4a-1focal radosgw=17.2.6-1274-g68e53a4a-1focal python3-rados=17.2.6-1274-g68e53a4a-1focal python3-rgw=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal python3-rbd=17.2.6-1274-g68e53a4a-1focal libcephfs2=17.2.6-1274-g68e53a4a-1focal libcephfs-dev=17.2.6-1274-g68e53a4a-1focal librados2=17.2.6-1274-g68e53a4a-1focal librbd1=17.2.6-1274-g68e53a4a-1focal rbd-fuse=17.2.6-1274-g68e53a4a-1focal python3-cephfs=17.2.6-1274-g68e53a4a-1focal cephfs-shell=17.2.6-1274-g68e53a4a-1focal cephfs-top=17.2.6-1274-g68e53a4a-1focal cephfs-mirror=17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:49:52.971 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:49:53.038 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T03:49:53.039 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T03:49:53.176 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T03:49:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T03:49:53.221 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T03:49:53.225 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T03:49:53.226 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T03:49:53.227 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2023-10-06T03:49:53.228 INFO:teuthology.orchestra.run.smithi105.stdout: btrfs-tools 2023-10-06T03:49:53.347 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2023-10-06T03:49:53.347 INFO:teuthology.orchestra.run.smithi105.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T03:49:53.347 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T03:49:53.348 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T03:49:53.348 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T03:49:53.348 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T03:49:53.348 INFO:teuthology.orchestra.run.smithi105.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T03:49:53.348 INFO:teuthology.orchestra.run.smithi105.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T03:49:53.350 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T03:49:53.350 INFO:teuthology.orchestra.run.smithi105.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T03:49:53.350 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T03:49:53.351 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T03:49:53.351 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T03:49:53.351 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T03:49:53.351 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T03:49:53.351 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T03:49:53.352 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2023-10-06T03:49:53.353 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 librbd1 2023-10-06T03:49:53.369 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T03:49:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T03:49:53.371 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T03:49:53.371 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-10-06T03:49:53.371 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-06T03:49:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-06T03:49:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-06T03:49:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-06T03:49:53.372 INFO:teuthology.orchestra.run.smithi057.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-06T03:49:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-06T03:49:53.373 INFO:teuthology.orchestra.run.smithi057.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T03:49:53.374 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-10-06T03:49:53.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout:Recommended packages: 2023-10-06T03:49:53.376 INFO:teuthology.orchestra.run.smithi057.stdout: btrfs-tools 2023-10-06T03:49:53.412 INFO:teuthology.orchestra.run.smithi105.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T03:49:53.412 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 210 MB of archives. 2023-10-06T03:49:53.413 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T03:49:53.413 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T03:49:53.431 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T03:49:53.438 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T03:49:53.463 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T03:49:53.492 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T03:49:53.494 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-06T03:49:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-06T03:49:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-06T03:49:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-06T03:49:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-06T03:49:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-10-06T03:49:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-06T03:49:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-10-06T03:49:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-10-06T03:49:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-10-06T03:49:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-06T03:49:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-06T03:49:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-06T03:49:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-06T03:49:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-06T03:49:53.503 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-10-06T03:49:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 librbd1 2023-10-06T03:49:53.504 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T03:49:53.505 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T03:49:53.523 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T03:49:53.524 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T03:49:53.530 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T03:49:53.558 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T03:49:53.561 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T03:49:53.563 INFO:teuthology.orchestra.run.smithi057.stdout:2 upgraded, 114 newly installed, 0 to remove and 253 not upgraded. 2023-10-06T03:49:53.563 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 210 MB of archives. 2023-10-06T03:49:53.563 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 981 MB of additional disk space will be used. 2023-10-06T03:49:53.563 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-06T03:49:53.567 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T03:49:53.569 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T03:49:53.570 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T03:49:53.572 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T03:49:53.572 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T03:49:53.572 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T03:49:53.574 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T03:49:53.576 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T03:49:53.580 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T03:49:53.580 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T03:49:53.582 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-06T03:49:53.589 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-06T03:49:53.596 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T03:49:53.597 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T03:49:53.598 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T03:49:53.599 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T03:49:53.599 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T03:49:53.601 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T03:49:53.601 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T03:49:53.603 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T03:49:53.613 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T03:49:53.614 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T03:49:53.614 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-06T03:49:53.630 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T03:49:53.630 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T03:49:53.631 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T03:49:53.631 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T03:49:53.633 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T03:49:53.635 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T03:49:53.637 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T03:49:53.637 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T03:49:53.643 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-06T03:49:53.645 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-06T03:49:53.646 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T03:49:53.648 INFO:teuthology.orchestra.run.smithi105.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T03:49:53.655 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-06T03:49:53.657 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-06T03:49:53.663 INFO:teuthology.orchestra.run.smithi105.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T03:49:53.664 INFO:teuthology.orchestra.run.smithi105.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T03:49:53.665 INFO:teuthology.orchestra.run.smithi105.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T03:49:53.675 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-06T03:49:53.676 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-06T03:49:53.681 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-06T03:49:53.708 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-06T03:49:53.709 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-06T03:49:53.715 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-06T03:49:53.717 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-06T03:49:53.717 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-06T03:49:53.720 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-06T03:49:53.720 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-06T03:49:53.721 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-06T03:49:53.722 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-06T03:49:53.722 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1274-g68e53a4a-1focal [3,501 kB] 2023-10-06T03:49:53.730 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-06T03:49:53.730 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-06T03:49:53.746 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-06T03:49:53.749 INFO:teuthology.orchestra.run.smithi105.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T03:49:53.750 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-06T03:49:53.750 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-06T03:49:53.750 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-06T03:49:53.751 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-06T03:49:53.751 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-06T03:49:53.751 INFO:teuthology.orchestra.run.smithi057.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-06T03:49:53.753 INFO:teuthology.orchestra.run.smithi057.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-06T03:49:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-06T03:49:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-06T03:49:53.764 INFO:teuthology.orchestra.run.smithi105.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T03:49:53.766 INFO:teuthology.orchestra.run.smithi105.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T03:49:53.777 INFO:teuthology.orchestra.run.smithi105.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T03:49:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-06T03:49:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-06T03:49:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-06T03:49:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-06T03:49:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-06T03:49:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-06T03:49:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-06T03:49:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-06T03:49:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-06T03:49:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-06T03:49:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-06T03:49:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-06T03:49:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-06T03:49:53.843 INFO:teuthology.orchestra.run.smithi105.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T03:49:53.844 INFO:teuthology.orchestra.run.smithi105.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T03:49:53.845 INFO:teuthology.orchestra.run.smithi105.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T03:49:53.846 INFO:teuthology.orchestra.run.smithi105.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T03:49:53.847 INFO:teuthology.orchestra.run.smithi105.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T03:49:53.848 INFO:teuthology.orchestra.run.smithi105.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T03:49:53.850 INFO:teuthology.orchestra.run.smithi105.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T03:49:53.851 INFO:teuthology.orchestra.run.smithi105.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T03:49:53.859 INFO:teuthology.orchestra.run.smithi105.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T03:49:53.869 INFO:teuthology.orchestra.run.smithi105.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T03:49:53.871 INFO:teuthology.orchestra.run.smithi105.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T03:49:53.873 INFO:teuthology.orchestra.run.smithi105.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T03:49:53.874 INFO:teuthology.orchestra.run.smithi105.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T03:49:53.878 INFO:teuthology.orchestra.run.smithi105.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T03:49:53.881 INFO:teuthology.orchestra.run.smithi105.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T03:49:53.881 INFO:teuthology.orchestra.run.smithi105.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T03:49:53.882 INFO:teuthology.orchestra.run.smithi105.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T03:49:53.897 INFO:teuthology.orchestra.run.smithi105.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T03:49:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-06T03:49:53.899 INFO:teuthology.orchestra.run.smithi105.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T03:49:53.914 INFO:teuthology.orchestra.run.smithi057.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-06T03:49:53.916 INFO:teuthology.orchestra.run.smithi057.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-06T03:49:53.927 INFO:teuthology.orchestra.run.smithi057.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-06T03:49:53.928 INFO:teuthology.orchestra.run.smithi057.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-06T03:49:53.938 INFO:teuthology.orchestra.run.smithi105.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T03:49:53.939 INFO:teuthology.orchestra.run.smithi105.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T03:49:53.939 INFO:teuthology.orchestra.run.smithi105.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T03:49:53.939 INFO:teuthology.orchestra.run.smithi105.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T03:49:53.940 INFO:teuthology.orchestra.run.smithi105.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T03:49:53.940 INFO:teuthology.orchestra.run.smithi105.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T03:49:53.952 INFO:teuthology.orchestra.run.smithi105.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T03:49:53.953 INFO:teuthology.orchestra.run.smithi105.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T03:49:53.990 INFO:teuthology.orchestra.run.smithi105.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T03:49:53.990 INFO:teuthology.orchestra.run.smithi105.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T03:49:53.991 INFO:teuthology.orchestra.run.smithi057.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-06T03:49:53.992 INFO:teuthology.orchestra.run.smithi105.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T03:49:53.992 INFO:teuthology.orchestra.run.smithi057.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-06T03:49:53.993 INFO:teuthology.orchestra.run.smithi057.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-06T03:49:53.993 INFO:teuthology.orchestra.run.smithi105.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T03:49:53.994 INFO:teuthology.orchestra.run.smithi105.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T03:49:53.994 INFO:teuthology.orchestra.run.smithi057.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-06T03:49:53.995 INFO:teuthology.orchestra.run.smithi057.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-06T03:49:53.996 INFO:teuthology.orchestra.run.smithi105.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T03:49:53.997 INFO:teuthology.orchestra.run.smithi057.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-06T03:49:53.998 INFO:teuthology.orchestra.run.smithi105.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T03:49:53.998 INFO:teuthology.orchestra.run.smithi057.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-06T03:49:53.998 INFO:teuthology.orchestra.run.smithi105.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T03:49:54.008 INFO:teuthology.orchestra.run.smithi057.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-06T03:49:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-06T03:49:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-06T03:49:54.021 INFO:teuthology.orchestra.run.smithi105.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T03:49:54.025 INFO:teuthology.orchestra.run.smithi057.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-06T03:49:54.026 INFO:teuthology.orchestra.run.smithi057.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-06T03:49:54.029 INFO:teuthology.orchestra.run.smithi057.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-06T03:49:54.034 INFO:teuthology.orchestra.run.smithi057.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-06T03:49:54.035 INFO:teuthology.orchestra.run.smithi057.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-06T03:49:54.037 INFO:teuthology.orchestra.run.smithi105.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T03:49:54.038 INFO:teuthology.orchestra.run.smithi105.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T03:49:54.045 INFO:teuthology.orchestra.run.smithi105.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T03:49:54.046 INFO:teuthology.orchestra.run.smithi105.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T03:49:54.051 INFO:teuthology.orchestra.run.smithi057.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-06T03:49:54.054 INFO:teuthology.orchestra.run.smithi057.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-06T03:49:54.059 INFO:teuthology.orchestra.run.smithi105.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T03:49:54.090 INFO:teuthology.orchestra.run.smithi057.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-06T03:49:54.091 INFO:teuthology.orchestra.run.smithi057.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-06T03:49:54.091 INFO:teuthology.orchestra.run.smithi057.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-06T03:49:54.092 INFO:teuthology.orchestra.run.smithi057.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-06T03:49:54.092 INFO:teuthology.orchestra.run.smithi057.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-06T03:49:54.093 INFO:teuthology.orchestra.run.smithi057.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-06T03:49:54.104 INFO:teuthology.orchestra.run.smithi057.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-06T03:49:54.104 INFO:teuthology.orchestra.run.smithi057.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-06T03:49:54.151 INFO:teuthology.orchestra.run.smithi057.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-06T03:49:54.151 INFO:teuthology.orchestra.run.smithi057.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-06T03:49:54.154 INFO:teuthology.orchestra.run.smithi057.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-06T03:49:54.157 INFO:teuthology.orchestra.run.smithi057.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-06T03:49:54.157 INFO:teuthology.orchestra.run.smithi057.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-06T03:49:54.159 INFO:teuthology.orchestra.run.smithi057.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-06T03:49:54.160 INFO:teuthology.orchestra.run.smithi057.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-06T03:49:54.252 INFO:teuthology.orchestra.run.smithi105.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T03:49:54.255 INFO:teuthology.orchestra.run.smithi105.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T03:49:54.274 INFO:teuthology.orchestra.run.smithi105.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T03:49:55.356 INFO:teuthology.orchestra.run.smithi105.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T03:49:55.434 INFO:teuthology.orchestra.run.smithi057.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1274-g68e53a4a-1focal [3,551 kB] 2023-10-06T03:49:55.518 INFO:teuthology.orchestra.run.smithi105.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T03:49:55.526 INFO:teuthology.orchestra.run.smithi105.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T03:49:55.529 INFO:teuthology.orchestra.run.smithi105.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T03:49:55.591 INFO:teuthology.orchestra.run.smithi105.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T03:49:55.889 INFO:teuthology.orchestra.run.smithi105.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T03:49:56.221 INFO:teuthology.orchestra.run.smithi057.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1274-g68e53a4a-1focal [760 kB] 2023-10-06T03:49:56.311 INFO:teuthology.orchestra.run.smithi057.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1274-g68e53a4a-1focal [413 kB] 2023-10-06T03:49:56.389 INFO:teuthology.orchestra.run.smithi057.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1274-g68e53a4a-1focal [22.5 kB] 2023-10-06T03:49:56.390 INFO:teuthology.orchestra.run.smithi057.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1274-g68e53a4a-1focal [200 kB] 2023-10-06T03:49:56.461 INFO:teuthology.orchestra.run.smithi057.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1274-g68e53a4a-1focal [47.1 kB] 2023-10-06T03:49:56.462 INFO:teuthology.orchestra.run.smithi057.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1274-g68e53a4a-1focal [386 kB] 2023-10-06T03:49:56.541 INFO:teuthology.orchestra.run.smithi057.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1274-g68e53a4a-1focal [5,567 kB] 2023-10-06T03:49:57.192 INFO:teuthology.orchestra.run.smithi105.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T03:49:57.193 INFO:teuthology.orchestra.run.smithi105.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T03:49:57.206 INFO:teuthology.orchestra.run.smithi105.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T03:49:57.227 INFO:teuthology.orchestra.run.smithi105.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T03:49:57.227 INFO:teuthology.orchestra.run.smithi105.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T03:49:57.227 INFO:teuthology.orchestra.run.smithi105.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T03:49:57.280 INFO:teuthology.orchestra.run.smithi057.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1274-g68e53a4a-1focal [116 kB] 2023-10-06T03:49:57.283 INFO:teuthology.orchestra.run.smithi057.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1274-g68e53a4a-1focal [479 kB] 2023-10-06T03:49:57.305 INFO:teuthology.orchestra.run.smithi105.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T03:49:57.425 INFO:teuthology.orchestra.run.smithi057.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1274-g68e53a4a-1focal [27.7 MB] 2023-10-06T03:49:57.668 INFO:teuthology.orchestra.run.smithi105.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T03:49:57.668 INFO:teuthology.orchestra.run.smithi105.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T03:50:00.500 INFO:teuthology.orchestra.run.smithi105.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T03:50:00.504 INFO:teuthology.orchestra.run.smithi105.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T03:50:00.508 INFO:teuthology.orchestra.run.smithi105.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T03:50:00.509 INFO:teuthology.orchestra.run.smithi105.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T03:50:00.530 INFO:teuthology.orchestra.run.smithi057.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1274-g68e53a4a-1focal [6,449 kB] 2023-10-06T03:50:00.564 INFO:teuthology.orchestra.run.smithi105.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T03:50:00.565 INFO:teuthology.orchestra.run.smithi105.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T03:50:01.025 INFO:teuthology.orchestra.run.smithi057.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1274-g68e53a4a-1focal [221 kB] 2023-10-06T03:50:01.036 INFO:teuthology.orchestra.run.smithi057.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1274-g68e53a4a-1focal [152 kB] 2023-10-06T03:50:01.057 INFO:teuthology.orchestra.run.smithi057.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1274-g68e53a4a-1focal [1,590 kB] 2023-10-06T03:50:01.218 INFO:teuthology.orchestra.run.smithi057.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1274-g68e53a4a-1focal [7,846 kB] 2023-10-06T03:50:01.267 INFO:teuthology.orchestra.run.smithi105.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T03:50:01.577 INFO:teuthology.orchestra.run.smithi057.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1274-g68e53a4a-1focal [28.7 MB] 2023-10-06T03:50:01.895 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 210 MB in 8s (26.5 MB/s) 2023-10-06T03:50:02.038 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T03:50:02.094 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T03:50:02.098 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T03:50:02.144 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T03:50:02.430 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T03:50:02.450 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T03:50:02.480 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T03:50:02.817 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T03:50:02.837 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T03:50:02.875 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T03:50:02.951 INFO:teuthology.orchestra.run.smithi057.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1274-g68e53a4a-1focal [3,928 B] 2023-10-06T03:50:03.024 INFO:teuthology.orchestra.run.smithi057.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1274-g68e53a4a-1focal [870 kB] 2023-10-06T03:50:03.038 INFO:teuthology.orchestra.run.smithi057.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1274-g68e53a4a-1focal [2,406 kB] 2023-10-06T03:50:03.073 INFO:teuthology.orchestra.run.smithi057.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1274-g68e53a4a-1focal [79.1 kB] 2023-10-06T03:50:03.075 INFO:teuthology.orchestra.run.smithi057.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1274-g68e53a4a-1focal [117 kB] 2023-10-06T03:50:03.079 INFO:teuthology.orchestra.run.smithi057.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1274-g68e53a4a-1focal [1,760 kB] 2023-10-06T03:50:03.157 INFO:teuthology.orchestra.run.smithi057.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1274-g68e53a4a-1focal [7,886 kB] 2023-10-06T03:50:03.244 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T03:50:03.260 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T03:50:03.345 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T03:50:03.509 INFO:teuthology.orchestra.run.smithi057.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1274-g68e53a4a-1focal [4,040 B] 2023-10-06T03:50:03.509 INFO:teuthology.orchestra.run.smithi057.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1274-g68e53a4a-1focal [56.3 MB] 2023-10-06T03:50:03.714 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:03.841 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T03:50:04.543 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:04.703 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T03:50:05.390 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T03:50:05.410 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:05.457 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:05.759 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rados. 2023-10-06T03:50:05.775 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:05.809 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:06.195 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T03:50:06.212 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:06.253 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:06.289 INFO:teuthology.orchestra.run.smithi057.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1274-g68e53a4a-1focal [229 kB] 2023-10-06T03:50:06.293 INFO:teuthology.orchestra.run.smithi057.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-1274-g68e53a4a-1focal [239 kB] 2023-10-06T03:50:06.297 INFO:teuthology.orchestra.run.smithi057.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-1274-g68e53a4a-1focal [22.0 kB] 2023-10-06T03:50:06.298 INFO:teuthology.orchestra.run.smithi057.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-1274-g68e53a4a-1focal [12.8 kB] 2023-10-06T03:50:06.298 INFO:teuthology.orchestra.run.smithi057.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1274-g68e53a4a-1focal [21.9 kB] 2023-10-06T03:50:06.299 INFO:teuthology.orchestra.run.smithi057.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1274-g68e53a4a-1focal [17.0 MB] 2023-10-06T03:50:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T03:50:06.555 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:06.597 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:06.935 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T03:50:06.954 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:06.984 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:06.985 INFO:teuthology.orchestra.run.smithi057.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1274-g68e53a4a-1focal [79.4 kB] 2023-10-06T03:50:07.314 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T03:50:07.329 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T03:50:07.388 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T03:50:07.625 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T03:50:07.643 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:07.683 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:07.695 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 210 MB in 14s (15.5 MB/s) 2023-10-06T03:50:07.876 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-06T03:50:07.933 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-06T03:50:07.938 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-06T03:50:07.982 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-06T03:50:08.075 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T03:50:08.091 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T03:50:08.133 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T03:50:08.369 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-06T03:50:08.387 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-06T03:50:08.418 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T03:50:08.628 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T03:50:08.644 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T03:50:08.678 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T03:50:08.688 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cmd2. 2023-10-06T03:50:08.707 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-06T03:50:08.738 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-06T03:50:09.023 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T03:50:09.039 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T03:50:09.074 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-06T03:50:09.081 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T03:50:09.092 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-06T03:50:09.191 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T03:50:09.459 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T03:50:09.478 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T03:50:09.517 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T03:50:09.745 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../004-librbd1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:09.853 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T03:50:09.871 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librbd1 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T03:50:09.873 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T03:50:09.912 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T03:50:10.373 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T03:50:10.389 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:10.442 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:10.594 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../005-librados2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:10.717 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librados2 (17.2.6-1274-g68e53a4a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-06T03:50:10.927 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T03:50:10.946 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:10.985 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:11.347 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T03:50:11.366 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:11.371 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs2. 2023-10-06T03:50:11.388 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:11.405 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:11.421 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:11.757 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rados. 2023-10-06T03:50:11.778 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../007-python3-rados_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:11.808 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T03:50:11.815 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:11.824 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T03:50:11.866 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T03:50:12.202 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-06T03:50:12.220 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:12.228 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librgw2. 2023-10-06T03:50:12.244 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:12.260 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:12.286 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:12.496 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cephfs. 2023-10-06T03:50:12.514 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:12.554 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:12.899 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-06T03:50:12.916 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:12.957 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:13.063 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T03:50:13.080 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:13.122 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:13.236 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-prettytable. 2023-10-06T03:50:13.253 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-10-06T03:50:13.295 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-06T03:50:13.494 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liboath0. 2023-10-06T03:50:13.509 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T03:50:13.553 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rbd. 2023-10-06T03:50:13.569 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:13.576 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T03:50:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:13.864 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T03:50:13.882 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:13.922 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:13.944 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-06T03:50:13.963 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-06T03:50:13.994 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T03:50:14.345 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-06T03:50:14.363 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-06T03:50:14.384 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-common. 2023-10-06T03:50:14.395 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T03:50:14.402 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:14.442 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:14.731 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-06T03:50:14.748 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-06T03:50:14.823 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T03:50:15.194 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-06T03:50:15.210 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-06T03:50:15.243 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T03:50:15.580 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-06T03:50:15.596 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-06T03:50:15.638 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T03:50:16.100 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-06T03:50:16.116 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:16.168 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:16.620 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-06T03:50:16.639 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:16.687 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:17.074 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-06T03:50:17.092 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-06T03:50:17.132 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:50:17.189 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-base. 2023-10-06T03:50:17.207 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:17.257 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:17.495 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-06T03:50:17.514 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-06T03:50:17.552 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T03:50:17.897 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package librgw2. 2023-10-06T03:50:17.913 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../022-librgw2_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:17.955 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:18.252 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T03:50:18.270 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T03:50:18.310 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T03:50:18.705 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T03:50:18.716 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rgw. 2023-10-06T03:50:18.721 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T03:50:18.732 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:18.763 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T03:50:18.774 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:19.008 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T03:50:19.025 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:19.074 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:19.144 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liboath0. 2023-10-06T03:50:19.163 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-06T03:50:19.203 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-06T03:50:19.472 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T03:50:19.488 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T03:50:19.497 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libradosstriper1. 2023-10-06T03:50:19.515 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:19.531 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T03:50:19.555 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:19.858 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T03:50:19.873 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T03:50:19.916 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T03:50:20.036 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-common. 2023-10-06T03:50:20.052 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../026-ceph-common_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:20.094 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:20.286 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T03:50:20.306 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T03:50:20.344 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T03:50:20.689 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T03:50:20.710 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T03:50:20.747 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T03:50:21.067 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T03:50:21.084 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T03:50:21.125 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T03:50:21.470 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T03:50:21.487 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T03:50:21.528 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T03:50:21.856 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-mako. 2023-10-06T03:50:21.875 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T03:50:21.914 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T03:50:22.234 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T03:50:22.251 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T03:50:22.317 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T03:50:22.620 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T03:50:22.638 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T03:50:22.678 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T03:50:22.799 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-base. 2023-10-06T03:50:22.816 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../027-ceph-base_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:22.868 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:22.998 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webob. 2023-10-06T03:50:23.018 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T03:50:23.056 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T03:50:23.410 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T03:50:23.429 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T03:50:23.467 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T03:50:23.856 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cryptography. 2023-10-06T03:50:23.874 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-06T03:50:23.931 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T03:50:24.037 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T03:50:24.058 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T03:50:24.309 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-openssl. 2023-10-06T03:50:24.325 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-06T03:50:24.367 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-06T03:50:24.452 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T03:50:24.661 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-06T03:50:24.677 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:24.711 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:25.139 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T03:50:25.155 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T03:50:25.193 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T03:50:25.477 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T03:50:25.493 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T03:50:25.527 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T03:50:25.825 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-06T03:50:25.838 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-paste. 2023-10-06T03:50:25.841 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-06T03:50:25.855 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T03:50:25.883 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T03:50:25.896 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T03:50:26.208 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T03:50:26.226 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T03:50:26.236 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-06T03:50:26.252 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-06T03:50:26.257 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T03:50:26.294 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-06T03:50:26.544 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T03:50:26.562 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T03:50:26.602 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T03:50:26.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-natsort. 2023-10-06T03:50:26.632 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-10-06T03:50:26.672 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-06T03:50:26.913 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T03:50:26.932 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T03:50:26.997 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T03:50:27.009 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jwt. 2023-10-06T03:50:27.026 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-06T03:50:27.067 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T03:50:27.308 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T03:50:27.326 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T03:50:27.386 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-logutils. 2023-10-06T03:50:27.402 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T03:50:27.404 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-10-06T03:50:27.453 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-06T03:50:27.746 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T03:50:27.747 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-06T03:50:27.763 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T03:50:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-06T03:50:27.804 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T03:50:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-06T03:50:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-mako. 2023-10-06T03:50:28.133 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-06T03:50:28.166 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T03:50:28.183 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:28.194 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T03:50:28.224 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:28.511 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-06T03:50:28.530 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-06T03:50:28.569 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-06T03:50:28.610 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T03:50:28.627 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:28.668 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:28.872 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-06T03:50:28.891 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-06T03:50:28.939 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T03:50:29.147 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T03:50:29.163 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:29.238 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:29.241 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webob. 2023-10-06T03:50:29.259 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-06T03:50:29.300 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-06T03:50:29.652 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-06T03:50:29.671 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-06T03:50:29.710 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T03:50:30.022 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-bs4. 2023-10-06T03:50:30.042 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-10-06T03:50:30.080 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-06T03:50:30.400 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T03:50:30.416 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:30.458 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-waitress. 2023-10-06T03:50:30.458 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:30.474 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-06T03:50:30.519 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T03:50:30.861 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-tempita. 2023-10-06T03:50:30.877 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-10-06T03:50:30.919 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-06T03:50:31.238 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-paste. 2023-10-06T03:50:31.256 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-06T03:50:31.296 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T03:50:31.625 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-06T03:50:31.641 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-06T03:50:31.682 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T03:50:32.002 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-06T03:50:32.020 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-06T03:50:32.060 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-06T03:50:32.355 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webtest. 2023-10-06T03:50:32.374 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-10-06T03:50:32.446 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-06T03:50:32.757 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pecan. 2023-10-06T03:50:32.775 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-06T03:50:32.815 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T03:50:33.195 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-06T03:50:33.212 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-06T03:50:33.245 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph. 2023-10-06T03:50:33.253 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T03:50:33.260 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:33.328 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:33.548 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-06T03:50:33.567 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:33.597 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:33.638 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T03:50:33.655 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:33.696 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:33.967 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr. 2023-10-06T03:50:33.984 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:34.025 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:34.217 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T03:50:34.232 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:34.275 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:34.620 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mon. 2023-10-06T03:50:34.636 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:34.678 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:34.828 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephadm. 2023-10-06T03:50:34.847 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:34.886 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:35.239 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T03:50:35.256 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T03:50:35.305 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T03:50:35.650 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T03:50:35.666 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:35.708 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:35.957 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-osd. 2023-10-06T03:50:35.973 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:36.014 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:36.070 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T03:50:36.085 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T03:50:36.128 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T03:50:36.380 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T03:50:36.398 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T03:50:36.464 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T03:50:36.724 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T03:50:36.743 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T03:50:36.782 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T03:50:37.135 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-routes. 2023-10-06T03:50:37.152 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T03:50:37.193 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T03:50:37.546 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T03:50:37.564 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:37.604 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:38.116 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T03:50:38.133 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T03:50:38.174 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T03:50:38.510 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T03:50:38.528 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T03:50:38.569 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T03:50:38.938 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T03:50:38.956 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T03:50:38.960 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph. 2023-10-06T03:50:38.975 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../055-ceph_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:38.996 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T03:50:39.009 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:39.311 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-fuse. 2023-10-06T03:50:39.328 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:39.378 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:39.806 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mds. 2023-10-06T03:50:39.822 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:39.864 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:40.264 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T03:50:40.280 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T03:50:40.321 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T03:50:40.409 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephadm. 2023-10-06T03:50:40.427 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../058-cephadm_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:40.458 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:40.753 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-jinja2. 2023-10-06T03:50:40.769 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-10-06T03:50:40.813 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-06T03:50:40.859 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T03:50:40.876 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T03:50:40.916 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T03:50:41.295 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T03:50:41.312 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T03:50:41.353 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T03:50:41.397 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-06T03:50:41.415 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:41.767 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-06T03:50:41.786 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-10-06T03:50:41.825 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-06T03:50:42.061 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-underscore. 2023-10-06T03:50:42.077 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-06T03:50:42.078 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T03:50:42.096 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:42.119 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T03:50:42.136 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:42.430 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-06T03:50:42.446 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-06T03:50:42.488 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T03:50:42.816 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-routes. 2023-10-06T03:50:42.832 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-10-06T03:50:42.874 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-06T03:50:43.210 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-06T03:50:43.230 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:43.240 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T03:50:43.258 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T03:50:43.268 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:43.297 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T03:50:43.600 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T03:50:43.617 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T03:50:43.675 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T03:50:43.755 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-decorator. 2023-10-06T03:50:43.774 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-06T03:50:43.813 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T03:50:44.012 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T03:50:44.029 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T03:50:44.095 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T03:50:44.099 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-06T03:50:44.116 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-06T03:50:44.157 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T03:50:44.407 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T03:50:44.424 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T03:50:44.464 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T03:50:44.476 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-scipy. 2023-10-06T03:50:44.495 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-06T03:50:44.534 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-06T03:50:44.785 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T03:50:44.801 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T03:50:44.843 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T03:50:45.196 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T03:50:45.213 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T03:50:45.254 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T03:50:45.582 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T03:50:45.598 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T03:50:45.640 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T03:50:45.834 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-06T03:50:45.852 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-06T03:50:45.893 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T03:50:46.010 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T03:50:46.028 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T03:50:46.069 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T03:50:46.438 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-joblib. 2023-10-06T03:50:46.458 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-10-06T03:50:46.490 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T03:50:46.508 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T03:50:46.521 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-06T03:50:46.548 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T03:50:46.874 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-sklearn. 2023-10-06T03:50:46.894 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T03:50:46.894 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-06T03:50:46.910 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T03:50:46.924 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T03:50:46.952 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T03:50:47.516 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T03:50:47.535 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:47.574 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:47.640 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-06T03:50:47.657 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:47.698 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:47.952 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T03:50:47.968 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T03:50:48.010 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T03:50:48.373 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T03:50:48.391 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:50:48.430 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:50:48.733 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package jq. 2023-10-06T03:50:48.749 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:50:48.791 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:50:48.834 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-cachetools. 2023-10-06T03:50:48.852 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-10-06T03:50:48.892 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-06T03:50:49.044 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package socat. 2023-10-06T03:50:49.060 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T03:50:49.101 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T03:50:49.203 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-06T03:50:49.221 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-06T03:50:49.270 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T03:50:49.445 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T03:50:49.461 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T03:50:49.503 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T03:50:49.573 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-06T03:50:49.592 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-06T03:50:49.623 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T03:50:49.884 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-rsa. 2023-10-06T03:50:49.891 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-test. 2023-10-06T03:50:49.903 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-10-06T03:50:49.911 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:49.934 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-06T03:50:49.949 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:50.245 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-google-auth. 2023-10-06T03:50:50.262 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-10-06T03:50:50.312 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-06T03:50:50.614 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-blinker. 2023-10-06T03:50:50.634 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-06T03:50:50.673 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T03:50:50.992 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-06T03:50:51.008 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-06T03:50:51.050 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T03:50:51.370 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-06T03:50:51.390 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-06T03:50:51.428 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T03:50:51.850 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-websocket. 2023-10-06T03:50:51.869 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-06T03:50:51.908 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T03:50:52.245 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-06T03:50:52.261 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-06T03:50:52.302 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T03:50:52.892 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-06T03:50:52.909 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:52.950 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:53.269 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-06T03:50:53.286 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-10-06T03:50:53.319 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-06T03:50:53.698 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-06T03:50:53.716 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:50:53.755 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:50:54.033 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package jq. 2023-10-06T03:50:54.051 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:50:54.091 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:50:54.352 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package socat. 2023-10-06T03:50:54.369 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-10-06T03:50:54.410 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-06T03:50:54.747 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package xmlstarlet. 2023-10-06T03:50:54.764 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-06T03:50:54.804 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-06T03:50:55.036 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T03:50:55.053 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:55.094 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:55.180 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-test. 2023-10-06T03:50:55.197 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../089-ceph-test_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:55.238 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:55.843 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T03:50:55.860 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:55.901 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:56.272 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T03:50:56.288 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T03:50:56.330 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T03:50:56.616 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T03:50:56.633 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:56.674 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:56.926 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T03:50:56.942 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:50:57.010 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:57.258 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T03:50:57.274 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T03:50:57.316 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:50:57.836 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T03:50:57.855 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:50:57.928 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:50:58.322 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T03:50:58.338 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T03:50:58.414 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T03:50:58.743 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T03:50:58.760 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T03:50:58.826 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:00.225 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ceph-volume. 2023-10-06T03:51:00.244 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:51:00.283 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:00.440 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T03:51:00.458 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T03:51:00.498 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T03:51:00.713 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-06T03:51:00.729 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:00.771 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:00.851 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T03:51:00.872 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T03:51:00.909 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T03:51:01.099 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-colorama. 2023-10-06T03:51:01.115 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-06T03:51:01.157 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-06T03:51:01.220 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-attr. 2023-10-06T03:51:01.240 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T03:51:01.278 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T03:51:01.451 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-shell. 2023-10-06T03:51:01.468 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:51:01.510 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:01.664 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T03:51:01.683 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T03:51:01.722 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T03:51:01.762 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package cephfs-top. 2023-10-06T03:51:01.780 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-1274-g68e53a4a-1focal_all.deb ... 2023-10-06T03:51:01.820 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:02.034 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T03:51:02.050 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T03:51:02.106 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-06T03:51:02.108 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T03:51:02.123 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T03:51:02.164 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:02.446 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T03:51:02.462 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T03:51:02.537 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T03:51:02.638 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-06T03:51:02.658 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:02.698 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:03.015 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T03:51:03.033 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T03:51:03.073 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T03:51:03.126 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package nvme-cli. 2023-10-06T03:51:03.147 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-06T03:51:03.202 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T03:51:03.407 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T03:51:03.427 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T03:51:03.476 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T03:51:03.562 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-06T03:51:03.580 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-06T03:51:03.620 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:03.796 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T03:51:03.813 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T03:51:03.879 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T03:51:04.175 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T03:51:04.191 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T03:51:04.233 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T03:51:04.586 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-py. 2023-10-06T03:51:04.604 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T03:51:04.644 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T03:51:04.997 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T03:51:05.014 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T03:51:05.055 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T03:51:05.279 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-06T03:51:05.298 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-06T03:51:05.337 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-06T03:51:05.387 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T03:51:05.405 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T03:51:05.445 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T03:51:05.690 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-06T03:51:05.710 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-06T03:51:05.748 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T03:51:05.807 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T03:51:05.825 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T03:51:05.865 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T03:51:06.051 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-attr. 2023-10-06T03:51:06.069 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-10-06T03:51:06.109 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-06T03:51:06.160 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T03:51:06.177 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T03:51:06.217 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T03:51:06.470 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-webencodings. 2023-10-06T03:51:06.487 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-06T03:51:06.528 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T03:51:06.839 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-html5lib. 2023-10-06T03:51:06.856 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-10-06T03:51:06.897 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-06T03:51:06.988 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package radosgw. 2023-10-06T03:51:07.005 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:07.071 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:07.275 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-06T03:51:07.295 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-06T03:51:07.333 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T03:51:07.795 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-packaging. 2023-10-06T03:51:07.813 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-10-06T03:51:07.853 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-06T03:51:08.156 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pastescript. 2023-10-06T03:51:08.173 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-10-06T03:51:08.214 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-06T03:51:08.551 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pluggy. 2023-10-06T03:51:08.571 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-10-06T03:51:08.609 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-06T03:51:08.842 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T03:51:08.860 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:08.900 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:08.904 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-psutil. 2023-10-06T03:51:08.921 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-06T03:51:08.953 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T03:51:09.192 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T03:51:09.273 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-py. 2023-10-06T03:51:09.290 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-06T03:51:09.323 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T03:51:09.493 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T03:51:09.609 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-06T03:51:09.618 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T03:51:09.626 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-06T03:51:09.667 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T03:51:09.778 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T03:51:09.979 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:10.020 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-pytest. 2023-10-06T03:51:10.037 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-10-06T03:51:10.078 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-06T03:51:10.435 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package python3-simplejson. 2023-10-06T03:51:10.453 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-06T03:51:10.518 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T03:51:10.683 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user cephadm....done 2023-10-06T03:51:10.796 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-06T03:51:10.813 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-06T03:51:10.847 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:10.853 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T03:51:10.973 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T03:51:11.341 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T03:51:11.566 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package radosgw. 2023-10-06T03:51:11.584 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../114-radosgw_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:11.624 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:11.625 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:11.760 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T03:51:11.886 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T03:51:12.246 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T03:51:12.656 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T03:51:12.958 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T03:51:13.234 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T03:51:13.377 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package rbd-fuse. 2023-10-06T03:51:13.397 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-1274-g68e53a4a-1focal_amd64.deb ... 2023-10-06T03:51:13.435 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:13.535 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T03:51:13.732 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-06T03:51:13.820 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T03:51:14.049 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-06T03:51:14.121 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:14.175 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-06T03:51:14.301 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-06T03:51:14.430 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T03:51:14.489 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:14.547 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T03:51:14.865 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T03:51:15.149 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T03:51:15.159 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user cephadm....done 2023-10-06T03:51:15.297 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:15.434 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T03:51:15.454 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-06T03:51:15.585 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T03:51:15.799 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-06T03:51:15.953 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T03:51:16.075 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-06T03:51:16.235 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-06T03:51:16.361 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-06T03:51:16.412 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T03:51:16.695 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-06T03:51:16.722 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T03:51:17.074 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T03:51:17.097 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-06T03:51:17.383 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T03:51:17.557 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-06T03:51:17.728 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T03:51:17.858 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-06T03:51:18.046 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T03:51:18.142 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-06T03:51:18.347 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T03:51:18.460 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-06T03:51:18.473 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T03:51:18.599 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T03:51:18.744 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-argparse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:18.867 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T03:51:19.037 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-06T03:51:19.163 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-06T03:51:19.279 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T03:51:19.447 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-06T03:51:19.581 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T03:51:19.731 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-06T03:51:19.983 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T03:51:20.024 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-06T03:51:20.150 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-06T03:51:20.360 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T03:51:20.486 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:20.543 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-06T03:51:20.827 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-06T03:51:20.837 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:20.972 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T03:51:21.095 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-06T03:51:21.333 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T03:51:21.446 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-06T03:51:21.461 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T03:51:21.604 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T03:51:21.761 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-06T03:51:21.889 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T03:51:22.099 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-06T03:51:22.223 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:22.349 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T03:51:22.391 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-06T03:51:22.508 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T03:51:22.719 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-06T03:51:22.837 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-06T03:51:22.851 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T03:51:22.963 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-06T03:51:23.128 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T03:51:23.256 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-06T03:51:23.421 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T03:51:23.547 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T03:51:23.657 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-06T03:51:23.848 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T03:51:23.967 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-06T03:51:24.149 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T03:51:24.335 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-06T03:51:24.483 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T03:51:24.714 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-06T03:51:24.837 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T03:51:24.840 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:25.111 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T03:51:25.158 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:25.245 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T03:51:25.326 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-06T03:51:25.563 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T03:51:25.678 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-06T03:51:25.795 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-06T03:51:25.914 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T03:51:25.921 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-06T03:51:26.074 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T03:51:26.200 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T03:51:26.241 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-06T03:51:26.558 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:26.718 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-06T03:51:26.863 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T03:51:26.863 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-06T03:51:27.170 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-06T03:51:27.185 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:27.311 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T03:51:27.455 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-06T03:51:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-06T03:51:27.890 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-06T03:51:28.174 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-06T03:51:28.475 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-06T03:51:28.792 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:28.827 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-06T03:51:28.918 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:51:29.044 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T03:51:29.260 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-06T03:51:29.412 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T03:51:29.568 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-06T03:51:29.655 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-06T03:51:29.714 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T03:51:29.981 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-06T03:51:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:30.157 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T03:51:30.349 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-06T03:51:30.474 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-06T03:51:30.525 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:30.600 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-06T03:51:30.650 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T03:51:30.960 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-06T03:51:31.011 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:31.145 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T03:51:31.261 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librados2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:31.379 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-06T03:51:31.471 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T03:51:32.502 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:32.628 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T03:51:32.787 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T03:51:32.884 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:32.913 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:51:32.987 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:51:33.039 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T03:51:33.160 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-06T03:51:33.340 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T03:51:33.466 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T03:51:33.524 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-06T03:51:33.824 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-06T03:51:33.853 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:33.979 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:34.162 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-06T03:51:34.198 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T03:51:34.200 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T03:51:34.252 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-06T03:51:34.603 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:34.664 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:34.721 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-06T03:51:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T03:51:35.048 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libradosstriper1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:35.270 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T03:51:35.270 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-06T03:51:35.401 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T03:51:35.533 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-06T03:51:35.762 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:35.979 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:36.031 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:36.157 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:36.282 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:36.434 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T03:51:36.614 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librbd1 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:36.721 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T03:51:36.740 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-06T03:51:36.866 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-06T03:51:36.992 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-06T03:51:37.023 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:37.118 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-06T03:51:37.149 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:37.309 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:37.434 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T03:51:37.446 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-06T03:51:37.554 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-06T03:51:37.924 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-modules-core (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:38.075 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:38.304 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T03:51:38.308 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-06T03:51:38.355 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:38.760 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libcephfs-dev (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:38.895 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-06T03:51:38.932 INFO:teuthology.orchestra.run.smithi105.stdout:Adding group ceph....done 2023-10-06T03:51:39.197 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-06T03:51:39.337 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user ceph....done 2023-10-06T03:51:39.523 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-06T03:51:39.562 INFO:teuthology.orchestra.run.smithi105.stdout:Setting system user ceph properties....done 2023-10-06T03:51:39.566 INFO:teuthology.orchestra.run.smithi105.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T03:51:39.716 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T03:51:39.859 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rados (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:39.985 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up librgw2 (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:40.081 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T03:51:40.145 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-top (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:40.271 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rbd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:40.397 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up rbd-fuse (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:40.509 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:40.514 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-06T03:51:40.732 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T03:51:40.738 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T03:51:40.808 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-06T03:51:41.101 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-rgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:41.193 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:41.227 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-cephfs (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:41.336 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:41.339 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-shell (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-06T03:51:41.591 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T03:51:41.591 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T03:51:42.230 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:42.420 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-common (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:42.598 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T03:51:42.973 INFO:teuthology.orchestra.run.smithi057.stdout:Adding group ceph....done 2023-10-06T03:51:43.057 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:43.304 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T03:51:43.323 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T03:51:43.333 INFO:teuthology.orchestra.run.smithi057.stdout:Adding system user ceph....done 2023-10-06T03:51:43.512 INFO:teuthology.orchestra.run.smithi057.stdout:Setting system user ceph properties....done 2023-10-06T03:51:43.538 INFO:teuthology.orchestra.run.smithi057.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-06T03:51:43.689 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-06T03:51:43.752 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:43.974 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T03:51:43.994 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T03:51:43.994 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-06T03:51:44.444 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:44.483 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up cephfs-mirror (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:44.714 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T03:51:44.738 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-06T03:51:44.949 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T03:51:44.950 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T03:51:45.143 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-test (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:45.300 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up radosgw (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:45.405 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:45.530 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:45.574 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T03:51:45.574 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-06T03:51:45.673 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:45.922 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T03:51:45.922 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T03:51:46.246 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-base (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:46.383 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:46.526 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:46.677 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-06T03:51:46.677 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:46.819 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:47.095 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T03:51:47.120 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T03:51:47.140 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mds (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:47.345 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T03:51:47.399 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-06T03:51:47.408 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T03:51:47.825 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:48.060 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T03:51:48.073 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-06T03:51:48.546 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-osd (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:49.038 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T03:51:49.039 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-06T03:51:49.473 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:49.574 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:49.700 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mon (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:49.932 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T03:51:49.932 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-06T03:51:50.261 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T03:51:50.385 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-cephadm (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:50.503 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:50.654 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-mgr-dashboard (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:50.797 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ceph-volume (17.2.6-1274-g68e53a4a-1focal) ... 2023-10-06T03:51:50.845 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T03:51:50.848 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T03:51:50.918 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2023-10-06T03:51:50.946 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T03:51:51.076 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T03:51:51.127 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2023-10-06T03:51:51.140 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2023-10-06T03:51:51.327 INFO:teuthology.orchestra.run.smithi105.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T03:51:51.327 INFO:teuthology.orchestra.run.smithi105.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T03:51:51.327 INFO:teuthology.orchestra.run.smithi105.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T03:51:51.328 INFO:teuthology.orchestra.run.smithi105.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T03:51:51.328 INFO:teuthology.orchestra.run.smithi105.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T03:51:51.328 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T03:51:51.330 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T03:51:51.330 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T03:51:51.330 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2023-10-06T03:51:51.330 INFO:teuthology.orchestra.run.smithi105.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T03:51:51.331 INFO:teuthology.orchestra.run.smithi105.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T03:51:51.331 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T03:51:51.331 INFO:teuthology.orchestra.run.smithi105.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T03:51:51.332 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2023-10-06T03:51:51.332 INFO:teuthology.orchestra.run.smithi105.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T03:51:51.332 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T03:51:51.369 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T03:51:51.381 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2023-10-06T03:51:51.382 INFO:teuthology.orchestra.run.smithi105.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T03:51:51.382 INFO:teuthology.orchestra.run.smithi105.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T03:51:51.382 INFO:teuthology.orchestra.run.smithi105.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T03:51:51.383 INFO:teuthology.orchestra.run.smithi105.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T03:51:51.383 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2023-10-06T03:51:51.384 INFO:teuthology.orchestra.run.smithi105.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T03:51:51.481 INFO:teuthology.orchestra.run.smithi105.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T03:51:51.485 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 10.4 MB of archives. 2023-10-06T03:51:51.485 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T03:51:51.486 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T03:51:51.644 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T03:51:51.646 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T03:51:51.647 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T03:51:51.654 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T03:51:51.655 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T03:51:51.694 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T03:51:51.699 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T03:51:51.699 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T03:51:51.700 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T03:51:51.700 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T03:51:51.701 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T03:51:51.702 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T03:51:51.705 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T03:51:51.705 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T03:51:51.726 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T03:51:51.736 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T03:51:51.736 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T03:51:51.744 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T03:51:51.754 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T03:51:51.777 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T03:51:51.777 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T03:51:51.781 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T03:51:51.799 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T03:51:51.817 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T03:51:51.820 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T03:51:51.820 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T03:51:51.821 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T03:51:51.821 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T03:51:52.138 INFO:teuthology.orchestra.run.smithi105.stdout:Preconfiguring packages ... 2023-10-06T03:51:52.269 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 10.4 MB in 0s (24.3 MB/s) 2023-10-06T03:51:52.841 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:51:52.846 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:51:53.018 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:51:54.194 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T03:51:54.305 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-06T03:51:54.880 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T03:51:54.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-10-06T03:51:54.978 INFO:teuthology.orchestra.run.smithi057.stdout:Reading package lists... 2023-10-06T03:51:55.186 INFO:teuthology.orchestra.run.smithi057.stdout:Building dependency tree... 2023-10-06T03:51:55.187 INFO:teuthology.orchestra.run.smithi057.stdout:Reading state information... 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-06T03:51:55.395 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages were automatically installed and are no longer required: 2023-10-06T03:51:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-06T03:51:55.396 INFO:teuthology.orchestra.run.smithi057.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-06T03:51:55.396 INFO:teuthology.orchestra.run.smithi057.stdout:The following additional packages will be installed: 2023-10-06T03:51:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-06T03:51:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-10-06T03:51:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-10-06T03:51:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: usb-modeswitch-data wpasupplicant 2023-10-06T03:51:55.399 INFO:teuthology.orchestra.run.smithi057.stdout:Suggested packages: 2023-10-06T03:51:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-10-06T03:51:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-10-06T03:51:55.448 INFO:teuthology.orchestra.run.smithi057.stdout:The following NEW packages will be installed: 2023-10-06T03:51:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-06T03:51:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-10-06T03:51:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-06T03:51:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-06T03:51:55.450 INFO:teuthology.orchestra.run.smithi057.stdout:The following packages will be upgraded: 2023-10-06T03:51:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-06T03:51:55.631 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:51:55.642 INFO:teuthology.orchestra.run.smithi057.stdout:6 upgraded, 23 newly installed, 0 to remove and 247 not upgraded. 2023-10-06T03:51:55.642 INFO:teuthology.orchestra.run.smithi057.stdout:Need to get 10.4 MB of archives. 2023-10-06T03:51:55.642 INFO:teuthology.orchestra.run.smithi057.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-10-06T03:51:55.642 INFO:teuthology.orchestra.run.smithi057.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-06T03:51:55.643 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:51:55.803 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:51:56.210 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:51:56.258 INFO:teuthology.orchestra.run.smithi057.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-06T03:51:56.268 INFO:teuthology.orchestra.run.smithi057.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-06T03:51:56.268 INFO:teuthology.orchestra.run.smithi057.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-06T03:51:56.273 INFO:teuthology.orchestra.run.smithi057.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-06T03:51:56.275 INFO:teuthology.orchestra.run.smithi057.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-06T03:51:56.374 INFO:teuthology.orchestra.run.smithi057.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-06T03:51:56.375 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:51:56.377 INFO:teuthology.orchestra.run.smithi057.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-06T03:51:56.384 INFO:teuthology.orchestra.run.smithi057.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-06T03:51:56.389 INFO:teuthology.orchestra.run.smithi057.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-06T03:51:56.389 INFO:teuthology.orchestra.run.smithi057.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-06T03:51:56.556 INFO:teuthology.orchestra.run.smithi057.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-06T03:51:56.738 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T03:51:56.828 INFO:teuthology.orchestra.run.smithi057.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-06T03:51:56.957 INFO:teuthology.orchestra.run.smithi057.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-06T03:51:56.963 INFO:teuthology.orchestra.run.smithi057.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-06T03:51:57.058 INFO:teuthology.orchestra.run.smithi057.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-06T03:51:57.063 INFO:teuthology.orchestra.run.smithi057.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-06T03:51:57.145 INFO:teuthology.orchestra.run.smithi057.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-06T03:51:57.195 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:51:57.303 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:51:57.303 INFO:teuthology.orchestra.run.smithi057.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-06T03:51:57.303 INFO:teuthology.orchestra.run.smithi057.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-06T03:51:57.308 INFO:teuthology.orchestra.run.smithi057.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-06T03:51:57.309 INFO:teuthology.orchestra.run.smithi057.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-06T03:51:57.325 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T03:51:57.503 INFO:teuthology.orchestra.run.smithi057.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-06T03:51:57.958 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:51:58.144 INFO:teuthology.orchestra.run.smithi057.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-06T03:51:58.257 INFO:teuthology.orchestra.run.smithi057.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-06T03:51:58.273 INFO:teuthology.orchestra.run.smithi057.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-06T03:51:58.275 INFO:teuthology.orchestra.run.smithi057.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-06T03:51:58.275 INFO:teuthology.orchestra.run.smithi057.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-06T03:51:58.277 INFO:teuthology.orchestra.run.smithi057.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-06T03:51:58.614 INFO:teuthology.orchestra.run.smithi057.stdout:Preconfiguring packages ... 2023-10-06T03:51:58.715 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T03:51:58.763 INFO:teuthology.orchestra.run.smithi057.stdout:Fetched 10.4 MB in 3s (3,702 kB/s) 2023-10-06T03:51:58.990 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:51:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:51:59.175 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:51:59.338 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T03:51:59.478 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T03:52:00.007 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T03:52:00.024 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T03:52:00.065 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T03:52:00.289 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-06T03:52:00.418 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package dump. 2023-10-06T03:52:00.436 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T03:52:00.476 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T03:52:00.805 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package indent. 2023-10-06T03:52:00.823 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:52:00.863 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T03:52:01.204 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T03:52:01.224 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T03:52:01.275 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T03:52:01.586 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T03:52:01.603 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T03:52:01.678 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T03:52:01.687 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:52:01.691 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:52:01.824 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:52:01.947 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T03:52:02.963 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-06T03:52:02.963 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-06T03:52:02.963 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T03:52:02.964 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:52:02.964 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:02.964 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T03:52:02.964 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:02.964 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:02.965 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T03:52:02.965 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:02.965 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:03.173 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T03:52:03.533 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:03.536 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:03.537 INFO:teuthology.orchestra.run.smithi057.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152665 files and directories currently installed.) 2023-10-06T03:52:03.538 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:52:03.538 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T03:52:03.617 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T03:52:03.634 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T03:52:03.675 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T03:52:04.349 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:52:04.479 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T03:52:04.488 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-06T03:52:04.498 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T03:52:04.713 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:05.632 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T03:52:05.634 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:05.635 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:05.635 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T03:52:05.635 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-06T03:52:05.635 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-06T03:52:05.635 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-06T03:52:05.647 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-06T03:52:05.744 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T03:52:06.100 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package dump. 2023-10-06T03:52:06.103 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-06T03:52:06.103 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking dump (0.4b46-6) ... 2023-10-06T03:52:06.103 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:06.103 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:06.104 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T03:52:06.104 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T03:52:06.146 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:06.379 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package indent. 2023-10-06T03:52:06.411 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-06T03:52:06.438 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T03:52:06.675 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T03:52:06.735 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-06T03:52:06.737 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T03:52:06.737 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T03:52:06.753 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-06T03:52:06.782 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T03:52:07.119 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package modemmanager. 2023-10-06T03:52:07.140 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:07.201 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-06T03:52:07.201 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:07.203 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-06T03:52:07.244 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T03:52:07.497 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-06T03:52:07.516 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-06T03:52:07.589 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:07.834 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T03:52:07.851 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T03:52:07.892 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T03:52:07.942 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-06T03:52:07.968 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:07.992 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:08.295 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-06T03:52:08.312 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:08.353 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:08.472 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager. 2023-10-06T03:52:08.490 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T03:52:08.556 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:08.681 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-06T03:52:08.913 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:08.914 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:09.126 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-06T03:52:09.143 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-06T03:52:09.184 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T03:52:09.296 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ppp. 2023-10-06T03:52:09.314 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T03:52:09.588 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T03:52:09.835 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-06T03:52:09.856 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T03:52:10.057 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:10.059 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T03:52:10.060 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T03:52:10.060 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T03:52:10.234 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-06T03:52:11.167 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T03:52:11.167 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T03:52:11.167 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-06T03:52:11.168 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-06T03:52:11.176 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:11.384 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T03:52:11.648 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T03:52:11.648 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T03:52:11.648 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-06T03:52:11.648 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-10-06T03:52:11.648 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-06T03:52:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T03:52:11.871 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T03:52:11.923 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T03:52:11.955 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package modemmanager. 2023-10-06T03:52:11.972 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-06T03:52:12.024 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:12.218 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:12.603 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T03:52:12.645 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package wpasupplicant. 2023-10-06T03:52:12.699 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-06T03:52:12.703 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T03:52:12.762 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T03:52:12.888 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T03:52:13.275 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager. 2023-10-06T03:52:13.313 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-06T03:52:13.316 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T03:52:13.316 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T03:52:13.359 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:13.800 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T03:52:13.926 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T03:52:14.058 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package ppp. 2023-10-06T03:52:14.092 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:14.093 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-06T03:52:14.194 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T03:52:14.320 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:14.339 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T03:52:14.446 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T03:52:14.705 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package pptp-linux. 2023-10-06T03:52:14.722 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-06T03:52:14.763 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-06T03:52:15.462 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T03:52:15.493 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-06T03:52:15.511 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-06T03:52:15.569 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-06T03:52:15.694 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T03:52:15.789 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T03:52:15.796 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-06T03:52:15.814 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-06T03:52:15.846 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-06T03:52:15.879 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:15.988 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T03:52:16.114 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T03:52:16.225 INFO:teuthology.orchestra.run.smithi057.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-06T03:52:16.249 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T03:52:16.249 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-06T03:52:16.294 INFO:teuthology.orchestra.run.smithi057.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T03:52:16.467 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T03:52:16.611 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:16.611 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:16.719 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:16.853 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T03:52:16.931 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-06T03:52:16.988 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:17.057 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-06T03:52:17.097 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:17.183 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-06T03:52:17.623 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T03:52:17.634 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-06T03:52:17.868 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:17.868 INFO:teuthology.orchestra.run.smithi105.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T03:52:17.868 INFO:teuthology.orchestra.run.smithi105.stdout:which means they are currently configured by ifupdown: 2023-10-06T03:52:17.868 INFO:teuthology.orchestra.run.smithi105.stdout:- enp3s0f1 2023-10-06T03:52:17.869 INFO:teuthology.orchestra.run.smithi105.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T03:52:17.869 INFO:teuthology.orchestra.run.smithi105.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T03:52:17.869 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:18.023 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T03:52:18.212 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-06T03:52:18.221 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-06T03:52:18.331 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-06T03:52:18.348 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T03:52:18.456 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-06T03:52:18.582 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:18.708 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-06T03:52:18.885 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T03:52:19.384 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:19.568 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T03:52:19.661 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-06T03:52:19.711 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:19.837 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:19.898 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up dump (0.4b46-6) ... 2023-10-06T03:52:19.994 INFO:teuthology.orchestra.run.smithi057.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-06T03:52:19.996 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:20.059 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:20.122 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:20.185 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-06T03:52:20.336 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-06T03:52:20.395 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T03:52:20.395 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T03:52:20.464 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-06T03:52:20.907 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-06T03:52:20.942 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T03:52:21.043 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T03:52:21.169 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T03:52:21.198 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:21.318 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:21.444 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-06T03:52:21.612 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:21.712 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T03:52:22.039 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-06T03:52:22.040 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T03:52:22.472 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:22.781 INFO:teuthology.orchestra.run.smithi057.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-06T03:52:22.782 INFO:teuthology.orchestra.run.smithi057.stdout:which means they are currently configured by ifupdown: 2023-10-06T03:52:22.782 INFO:teuthology.orchestra.run.smithi057.stdout:- ens1f0 2023-10-06T03:52:22.782 INFO:teuthology.orchestra.run.smithi057.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-06T03:52:22.782 INFO:teuthology.orchestra.run.smithi057.stdout:remove their configuration from /etc/network/interfaces. 2023-10-06T03:52:22.782 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:22.783 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-06T03:52:22.943 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-06T03:52:23.486 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-06T03:52:23.966 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-06T03:52:24.101 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-06T03:52:24.220 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-06T03:52:24.320 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:24.524 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-06T03:52:24.605 INFO:teuthology.orchestra.run.smithi057.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-06T03:52:24.882 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T03:52:24.959 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-06T03:52:25.375 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-06T03:52:25.484 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-06T03:52:25.610 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-06T03:52:25.761 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-06T03:52:25.841 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T03:52:25.958 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T03:52:26.054 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-06T03:52:26.772 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T03:52:26.836 DEBUG:teuthology.parallel:result is None 2023-10-06T03:52:29.998 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-06T03:52:30.098 INFO:teuthology.orchestra.run.smithi057.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-06T03:52:30.987 INFO:teuthology.orchestra.run.smithi057.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-06T03:52:31.014 DEBUG:teuthology.parallel:result is None 2023-10-06T03:52:31.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:52:31.292 DEBUG:teuthology.orchestra.run.smithi057:> dpkg-query -W -f '${Version}' ceph 2023-10-06T03:52:31.315 INFO:teuthology.orchestra.run.smithi057.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:52:31.316 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:52:31.316 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T03:52:31.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:52:31.458 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-query -W -f '${Version}' ceph 2023-10-06T03:52:31.481 INFO:teuthology.orchestra.run.smithi105.stdout:17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:52:31.487 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274-g68e53a4a-1focal 2023-10-06T03:52:31.488 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274-g68e53a4a-1focal is installed. 2023-10-06T03:52:31.488 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T03:52:31.488 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:31.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:52:31.505 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:31.547 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:52:31.564 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T03:52:31.597 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:31.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:52:31.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:52:31.672 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:31.703 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:52:31.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:52:31.768 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T03:52:31.768 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:31.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:52:31.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:52:31.841 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:31.859 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:52:31.875 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:52:31.916 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T03:52:31.919 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:31.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:52:31.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:52:31.993 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:32.014 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:52:32.030 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:52:32.086 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T03:52:32.152 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T03:52:32.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-10-06T03:52:32.212 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2023-10-06T03:52:32.228 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T03:52:32.228 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:52:32.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:52:32.286 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T03:52:32.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:52:32.289 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:52:32.308 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T03:52:32.356 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T03:52:32.356 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T03:52:32.356 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:32.356 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:52:32.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:52:32.443 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:32.443 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:52:32.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:52:32.534 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T03:52:32.534 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T03:52:32.535 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412230', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'kclient': {'disabled': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['fs/test_python.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T03:52:32.535 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:52:32.537 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:52:32.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:52:32.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:52:32.614 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:32.675 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:52:32.683 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:52:32.683 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-10-06T03:52:32.732 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:52:32.748 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 03:48:10.337526593 +0000 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 03:48:10.057533036 +0000 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 03:48:10.057533036 +0000 2023-10-06T03:52:32.749 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T03:52:32.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:52:32.765 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:52:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:52:32.787 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000554096 s, 924 kB/s 2023-10-06T03:52:32.788 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:52:32.797 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-10-06T03:52:32.844 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:52:32.844 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:32.844 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 368 Links: 1 2023-10-06T03:52:32.845 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:32.845 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 03:48:10.969512053 +0000 2023-10-06T03:52:32.845 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 03:48:10.689518494 +0000 2023-10-06T03:52:32.845 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 03:48:10.689518494 +0000 2023-10-06T03:52:32.845 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T03:52:32.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:52:32.858 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:52:32.858 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:52:32.859 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000530899 s, 964 kB/s 2023-10-06T03:52:32.861 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:52:32.869 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-10-06T03:52:32.917 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 03:48:11.249505610 +0000 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 03:48:11.245505703 +0000 2023-10-06T03:52:32.946 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 03:48:11.245505703 +0000 2023-10-06T03:52:32.947 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T03:52:32.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:52:32.962 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:52:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:52:32.993 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00047481 s, 1.1 MB/s 2023-10-06T03:52:32.994 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:52:33.046 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-10-06T03:52:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:52:33.053 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-06T03:52:33.053 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:33.061 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-10-06 03:48:11.753494015 +0000 2023-10-06T03:52:33.061 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-10-06 03:48:11.749494108 +0000 2023-10-06T03:52:33.061 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-10-06 03:48:11.749494108 +0000 2023-10-06T03:52:33.061 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-10-06T03:52:33.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:52:33.077 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-10-06T03:52:33.133 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-10-06T03:52:33.133 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000476893 s, 1.1 MB/s 2023-10-06T03:52:33.134 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:52:33.144 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:33.154 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:33.154 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:52:33.161 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:52:33.162 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 03:48:10.033524664 +0000 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 03:48:10.029524756 +0000 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 03:48:10.029524756 +0000 2023-10-06T03:52:33.169 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T03:52:33.170 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:52:33.181 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T03:52:33.181 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T03:52:33.182 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000398601 s, 1.3 MB/s 2023-10-06T03:52:33.182 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:52:33.235 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2023-10-06T03:52:33.300 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:52:33.300 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:33.300 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-10-06T03:52:33.300 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:33.300 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 03:48:10.813506705 +0000 2023-10-06T03:52:33.301 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 03:48:10.533513153 +0000 2023-10-06T03:52:33.301 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 03:48:10.533513153 +0000 2023-10-06T03:52:33.301 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T03:52:33.301 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:52:33.360 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T03:52:33.360 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T03:52:33.360 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000405807 s, 1.3 MB/s 2023-10-06T03:52:33.361 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:52:33.370 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2023-10-06T03:52:33.375 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:52:33.375 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 03:48:11.321495009 +0000 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 03:48:11.029501732 +0000 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 03:48:11.029501732 +0000 2023-10-06T03:52:33.376 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T03:52:33.376 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:52:33.391 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T03:52:33.391 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T03:52:33.391 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000326413 s, 1.6 MB/s 2023-10-06T03:52:33.392 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:52:33.443 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2023-10-06T03:52:33.464 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2023-10-06 03:48:11.837483128 +0000 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2023-10-06 03:48:11.573489205 +0000 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2023-10-06 03:48:11.573489205 +0000 2023-10-06T03:52:33.465 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2023-10-06T03:52:33.465 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:52:33.478 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2023-10-06T03:52:33.478 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2023-10-06T03:52:33.478 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.00041616 s, 1.2 MB/s 2023-10-06T03:52:33.479 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:52:33.531 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:33.531 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:52:33.531 INFO:tasks.ceph:Generating config... 2023-10-06T03:52:33.532 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T03:52:33.533 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T03:52:33.533 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T03:52:33.533 INFO:tasks.ceph:[client] pid file = 2023-10-06T03:52:33.533 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T03:52:33.533 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T03:52:33.533 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T03:52:33.534 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T03:52:33.534 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T03:52:33.534 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T03:52:33.535 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T03:52:33.565 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T03:52:33.565 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T03:52:33.565 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T03:52:33.566 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T03:52:33.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T03:52:33.602 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T03:52:33.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T03:52:33.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:52:33.717 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2023-10-06T03:52:33.750 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T03:52:33.751 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:33.752 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:52:33.759 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:33.827 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:33.840 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 366944c0-d2dc-4741-a456-286f74205a0c 2023-10-06T03:52:33.840 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = octopus 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 366944c0-d2dc-4741-a456-286f74205a0c 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2023-10-06T03:52:33.825457+0000 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:created 2023-10-06T03:52:33.825457+0000 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 15 (octopus) 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2023-10-06T03:52:33.841 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T03:52:33.843 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:52:33.892 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 366944c0-d2dc-4741-a456-286f74205a0c... 2023-10-06T03:52:33.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:52:33.943 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:52:33.976 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-10-06T03:52:33.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.980 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-10-06T03:52:33.981 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-10-06T03:52:33.982 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 366944c0-d2dc-4741-a456-286f74205a0c 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-10-06T03:52:33.983 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-10-06T03:52:33.984 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-10-06T03:52:33.985 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-10-06T03:52:33.986 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.987 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-10-06T03:52:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:52:33.988 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-10-06T03:52:33.989 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-10-06T03:52:33.989 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-10-06T03:52:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-10-06T03:52:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-10-06T03:52:33.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:52:33.998 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:52:33.999 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:52:34.000 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-10-06T03:52:34.001 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-10-06T03:52:34.002 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-10-06T03:52:34.003 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2023-10-06T03:52:34.003 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2023-10-06T03:52:34.004 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.005 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:52:34.006 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.57,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 366944c0-d2dc-4741-a456-286f74205a0c 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2023-10-06T03:52:34.007 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.008 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2023-10-06T03:52:34.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2023-10-06T03:52:34.010 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2023-10-06T03:52:34.011 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2023-10-06T03:52:34.012 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.013 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2023-10-06T03:52:34.014 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2023-10-06T03:52:34.015 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2023-10-06T03:52:34.041 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2023-10-06T03:52:34.042 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2023-10-06T03:52:34.043 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2023-10-06T03:52:34.044 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2023-10-06T03:52:34.044 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2023-10-06T03:52:34.044 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2023-10-06T03:52:34.044 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T03:52:34.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T03:52:34.096 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T03:52:34.103 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:34.103 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T03:52:34.108 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:34.108 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T03:52:34.160 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:52:34.180 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:34.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:52:34.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:52:34.207 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:52:34.207 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:34.214 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:52:34.215 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:34.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:52:34.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:52:34.242 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:52:34.275 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:34.293 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T03:52:34.296 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T03:52:34.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:52:34.341 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:52:34.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:52:34.401 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:52:34.403 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T03:52:34.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:52:34.449 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:52:34.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T03:52:34.475 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:52:34.525 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:52:34.526 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T03:52:34.542 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T03:52:34.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T03:52:34.578 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T03:52:34.616 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T03:52:34.616 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:52:34.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T03:52:34.673 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:34.688 INFO:tasks.ceph:role: osd.0 2023-10-06T03:52:34.688 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:52:34.688 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:52:36.027 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:36.028 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:36.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T03:52:36.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T03:52:36.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T03:52:36.109 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:36.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:36.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T03:52:36.186 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:36.225 INFO:tasks.ceph:role: osd.1 2023-10-06T03:52:36.225 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:52:36.226 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:52:37.569 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:37.569 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:37.569 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:37.569 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T03:52:37.569 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:37.570 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:37.570 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:37.570 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:37.570 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:37.570 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:37.572 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T03:52:37.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T03:52:37.598 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T03:52:37.614 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:37.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:37.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T03:52:37.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:37.718 INFO:tasks.ceph:role: osd.2 2023-10-06T03:52:37.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:52:37.719 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:52:39.058 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:39.123 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:39.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T03:52:39.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T03:52:39.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T03:52:39.209 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:39.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:39.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T03:52:39.225 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:39.225 INFO:tasks.ceph:role: osd.3 2023-10-06T03:52:39.225 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:52:39.225 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:40.564 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:40.565 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:40.565 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:40.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-10-06T03:52:40.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T03:52:40.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T03:52:40.684 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:40.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:40.692 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:40.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T03:52:40.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T03:52:40.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:52:40.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:52:40.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:52:40.829 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:40.796+0000 7f0121c6d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T03:52:41.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:41.372+0000 7f0121c6d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:42.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:42.156+0000 7f0121c6d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:42.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:42.948+0000 7f0121c6d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:43.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:52:43.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:43.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.868+0000 7f3949a733c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:52:43.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.868+0000 7f3949a733c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:52:43.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.868+0000 7f3949a733c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:52:43.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.868+0000 7f3949a733c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:52:43.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.868+0000 7f3949a733c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:52:43.913 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:43.872+0000 7f3949a733c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:52:44.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:44.440+0000 7f3949a733c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:45.224+0000 7f3949a733c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:46.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:46.016+0000 7f3949a733c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:46.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:52:46.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:47.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:52:47.218 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:52:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:52:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:52:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:52:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.215+0000 7ff6ecec13c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:52:47.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:47.787+0000 7ff6ecec13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:48.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:48.587+0000 7ff6ecec13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:49.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:49.363+0000 7ff6ecec13c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:50.277 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:52:50.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:50.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:52:50.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:52:50.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:52:50.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:52:50.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:52:50.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.371+0000 7fa5aabb93c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:52:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:50.935+0000 7fa5aabb93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:51.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:51.727+0000 7fa5aabb93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:52.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:52:52.507+0000 7fa5aabb93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:53.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:52:53.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:52:53.478 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:53.484 INFO:tasks.ceph:role: osd.4 2023-10-06T03:52:53.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:52:53.484 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:52:54.058 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:54.058 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:54.058 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:54.058 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:54.059 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:54.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:52:54.061 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:52:54.163 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:52:54.173 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:54.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:54.174 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:52:54.185 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:54.189 INFO:tasks.ceph:role: osd.5 2023-10-06T03:52:54.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:52:54.189 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:52:54.721 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:54.726 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:54.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:52:54.727 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:52:54.765 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:52:54.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:54.787 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:54.787 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:52:54.844 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:54.844 INFO:tasks.ceph:role: osd.6 2023-10-06T03:52:54.845 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:52:54.845 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:52:55.327 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:55.327 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:55.327 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:55.328 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:55.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:52:55.330 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:52:55.383 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:52:55.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:55.400 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:55.401 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:52:55.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:52:55.460 INFO:tasks.ceph:role: osd.7 2023-10-06T03:52:55.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:52:55.460 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:52:55.979 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:52:55.979 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:52:55.979 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:52:55.979 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:52:55.980 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:52:55.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2023-10-06T03:52:55.981 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:52:56.032 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:52:56.044 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2023-10-06T03:52:56.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:52:56.046 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:56.174 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.166+0000 7f4a281263c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:52:56.175 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.166+0000 7f4a281263c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:52:56.175 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.166+0000 7f4a281263c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:52:56.175 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.166+0000 7f4a281263c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:52:56.175 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.166+0000 7f4a281263c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:52:56.182 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.174+0000 7f4a281263c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:52:56.989 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:56.982+0000 7f4a281263c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:57.772 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:57.766+0000 7f4a281263c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:58.563 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:58.554+0000 7f4a281263c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:52:59.416 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:52:59.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:52:59.470 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:52:59.470 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:52:59.470 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:52:59.470 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:52:59.470 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:52:59.471 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:52:59.462+0000 7eff247f83c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:53:00.027 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:00.018+0000 7eff247f83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:00.817 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:00.810+0000 7eff247f83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:01.603 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:01.598+0000 7eff247f83c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:02.456 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:53:02.473 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:53:02.508 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:53:02.508 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:53:02.508 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:53:02.508 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:53:02.508 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:53:02.509 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:02.502+0000 7f557b16c3c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:53:02.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:53:02.539 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:53:03.073 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:03.066+0000 7f557b16c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:03.862 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:03.854+0000 7f557b16c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:04.661 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:04.654+0000 7f557b16c3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:05.511 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:53:05.527 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:53:05.564 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.554+0000 7f955f8fe3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:53:05.564 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.558+0000 7f955f8fe3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:53:05.564 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.558+0000 7f955f8fe3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:53:05.565 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.558+0000 7f955f8fe3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:53:05.565 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.558+0000 7f955f8fe3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:53:05.565 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:05.558+0000 7f955f8fe3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:53:06.125 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:06.118+0000 7f955f8fe3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:06.901 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:06.894+0000 7f955f8fe3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:07.686 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:07.678+0000 7f955f8fe3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:53:08.540 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:53:08.555 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:53:08.555 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:53:08.572 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:53:08.587 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:53:08.602 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:53:08.661 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:53:08.673 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:53:08.684 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.684 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:53:08.700 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.700 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:53:08.709 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.709 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:53:08.725 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.725 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:53:08.783 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.783 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:53:08.793 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:08.793 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:53:08.809 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:08.810 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:53:08.817 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:53:08.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:53:08.821 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:53:08.830 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-10-06T03:53:08.830 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCChB9lh0w4FBAAnQu6/gQ+2e7VRFhfEnc8oQ== 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCChB9ltHqoGhAA85tt+A5i6imJCJiD6RlOjQ== 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCIhB9ldt2xLxAApmMermQA1st5u4YY7vgz5g== 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCLhB9lgtQkNBAAWAszcFFJCSIXI46JJLBCwA== 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCPhB9lcu7iDBAA/g87p1HkfkdudQwBt8hLwQ== 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-10-06T03:53:08.831 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCShB9ljq0wFhAAexVvzgY+FQMA2kyayBmlYQ== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCChB9l9+qqFxAA1yy1rRI95fttD9XCZ80eAg== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCChB9li+YAHxAAUWhdRh1P+yNYX1oFxz6G9Q== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCYhB9lXYAfChAAHMUkw6CPc1ZURRzvObV5Mg== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCbhB9lBE64GxAAHQwOH+uwguq0E1xz5wJMbQ== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCehB9lyoEAHhAAsKFh9yoPNve13bDvVAF6Ag== 2023-10-06T03:53:08.832 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-10-06T03:53:08.833 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQChhB9lK6pUIRAALErkhIui4r1dGONUPO5r1g== 2023-10-06T03:53:08.833 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-10-06T03:53:08.833 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQCChB9lr11jIhAAv1z7Pv4teDf6BWU6zk3vkA== 2023-10-06T03:53:08.834 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2023-10-06T03:53:08.834 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCChB9lh0w4FBAAnQu6/gQ+2e7VRFhfEnc8oQ== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCChB9ltHqoGhAA85tt+A5i6imJCJiD6RlOjQ== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCIhB9ldt2xLxAApmMermQA1st5u4YY7vgz5g== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCLhB9lgtQkNBAAWAszcFFJCSIXI46JJLBCwA== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCPhB9lcu7iDBAA/g87p1HkfkdudQwBt8hLwQ== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCShB9ljq0wFhAAexVvzgY+FQMA2kyayBmlYQ== 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2023-10-06T03:53:08.835 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCChB9l9+qqFxAA1yy1rRI95fttD9XCZ80eAg== 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCChB9li+YAHxAAUWhdRh1P+yNYX1oFxz6G9Q== 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCYhB9lXYAfChAAHMUkw6CPc1ZURRzvObV5Mg== 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCbhB9lBE64GxAAHQwOH+uwguq0E1xz5wJMbQ== 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2023-10-06T03:53:08.836 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCehB9lyoEAHhAAsKFh9yoPNve13bDvVAF6Ag== 2023-10-06T03:53:08.837 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2023-10-06T03:53:08.837 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQChhB9lK6pUIRAALErkhIui4r1dGONUPO5r1g== 2023-10-06T03:53:08.837 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2023-10-06T03:53:08.837 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCChB9lr11jIhAAv1z7Pv4teDf6BWU6zk3vkA== 2023-10-06T03:53:08.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:53:08.879 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:53:08.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:53:08.926 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:53:08.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:08.974 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.060 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.108 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.154 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:53:09.237 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:53:09.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:53:09.323 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:53:09.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.460 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.507 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.598 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:53:09.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:53:09.683 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:53:09.733 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:53:09.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:53:09.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:53:09.802 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:53:09.815 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:53:09.831 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:53:09.884 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:53:09.897 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:53:09.956 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:53:10.012 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:53:10.027 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:53:10.030 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:53:10.034 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:53:10.034 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:53:10.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:53:10.037 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:53:10.037 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:53:10.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:53:10.077 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:53:10.077 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:53:10.077 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:53:10.080 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:53:10.080 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:53:10.080 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:53:10.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:53:10.082 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:53:10.082 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:53:10.083 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:53:10.085 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:53:10.085 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:53:10.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:53:10.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.175+0000 7f23f240a700 1 Processor -- start 2023-10-06T03:53:10.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.175+0000 7f23f240a700 1 -- start start 2023-10-06T03:53:10.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f240a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f240a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f240a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0af160 con 0x7f23ec0ae620 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f240a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0b1ac0 con 0x7f23ec068080 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f240a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec06f2f0 con 0x7f23ec068450 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23eb7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50966/0 (socket says 172.21.15.57:50966) 2023-10-06T03:53:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 learned_addr learned my addr 172.21.15.57:0/1797680140 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23f09a7700 1 --1- 172.21.15.57:0/1797680140 >> v1:172.21.15.105:6789/0 conn(0x7f23ec0ae620 0x7f23ec0aea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:58250/0 (socket says 172.21.15.57:58250) 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:10.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:10.779+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:11.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T03:53:11.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:11.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:11.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:11.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:11.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T03:53:13.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 msgr2=0x7f23ec140e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:13.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec068450 0x7f23ec140e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 msgr2=0x7f23ec140950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23ec068080 0x7f23ec140950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v1:172.21.15.105:6789/0 conn(0x7f23ec0ae620 legacy=0x7f23ec0aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0ace10 con 0x7f23cc0061b0 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0b1ac0 con 0x7f23cc003730 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:13.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:13.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:13.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:13.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:13.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:13.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:13.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.779+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.779+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:13.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:13.779+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:14.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:14.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:14.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:14.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:14.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:14.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:14.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:14.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:14.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:14.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 msgr2=0x7f23cc005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc003730 0x7f23cc005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v1:172.21.15.57:6789/0 conn(0x7f23cc0061b0 legacy=0x7f23cc008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 reap_dead start 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc00af30 con 0x7f23cc005b60 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc00fb60 con 0x7f23cc00a020 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0b1ac0 con 0x7f23cc00c230 2023-10-06T03:53:16.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:16.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:16.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:16.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:16.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.179+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:16.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.379+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:16.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.379+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:16.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.379+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:16.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.379+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:16.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.379+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.779+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.783+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.783+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.783+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:16.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:16.783+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:17.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:17.583+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:17.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:17.583+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:17.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:17.583+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:17.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:17.583+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:17.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:17.583+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T03:53:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 msgr2=0x7f23cc00e610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.57:3300/0 conn(0x7f23cc00c230 0x7f23cc00e610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v1:172.21.15.105:6789/0 conn(0x7f23cc00a020 legacy=0x7f23cc00a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 >> v1:172.21.15.57:6789/0 conn(0x7f23cc005b60 legacy=0x7f23cc008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec0b1ac0 con 0x7f23cc00fcf0 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23e9ffb700 1 -- 172.21.15.57:0/1797680140 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec06f2f0 con 0x7f23cc00ed90 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.179+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:19.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:19.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.379+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T03:53:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:19.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:19.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:19.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:19.783+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> v2:172.21.15.105:3300/0 conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23ebfff700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 msgr2=0x7f23cc00f160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23cc00ed90 0x7f23cc00f160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1797680140 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc010db0 con 0x7f23cc00fcf0 2023-10-06T03:53:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.583+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23cc0100f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006f00 tx=0x7f23dc008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98081d35994d3974 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23eaffd700 1 -- 172.21.15.57:0/1797680140 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc019920 con 0x7f23cc00fcf0 2023-10-06T03:53:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23eaffd700 1 -- 172.21.15.57:0/1797680140 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc019a80 con 0x7f23cc00fcf0 2023-10-06T03:53:20.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23eaffd700 1 -- 172.21.15.57:0/1797680140 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc019e00 con 0x7f23cc00fcf0 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 -- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 msgr2=0x7f23cc0100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23cc0100f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006f00 tx=0x7f23dc008040 comp rx=0 tx=0).stop 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f09a7700 1 -- 172.21.15.57:0/1797680140 reap_dead start 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 -- 172.21.15.57:0/1797680140 shutdown_connections 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 --2- 172.21.15.57:0/1797680140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23cc0100f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 -- 172.21.15.57:0/1797680140 >> 172.21.15.57:0/1797680140 conn(0x7f23ec0b5c30 msgr2=0x7f23ec0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 -- 172.21.15.57:0/1797680140 shutdown_connections 2023-10-06T03:53:20.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.587+0000 7f23f240a700 1 -- 172.21.15.57:0/1797680140 wait complete. 2023-10-06T03:53:20.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 Processor -- start 2023-10-06T03:53:20.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 -- start start 2023-10-06T03:53:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23ec146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0b3190 con 0x7f23ec0b4880 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec144e10 con 0x7f23cc00fcf0 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f240a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec145390 con 0x7f23ec134340 2023-10-06T03:53:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f09a7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45386/0 (socket says 172.21.15.57:45386) 2023-10-06T03:53:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1787263065 learned_addr learned my addr 172.21.15.57:0/1787263065 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:20.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23ebfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23ec146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f09a7700 1 -- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 msgr2=0x7f23ec134790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f09a7700 1 -- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 msgr2=0x7f23ec134790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23f09a7700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 msgr2=0x7f23ec134790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:20.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 msgr2=0x7f23ec146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23ec146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23eb7fe700 1 -- 172.21.15.57:0/1787263065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc00af30 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.591+0000 7f23ebfff700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23ec146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23eb7fe700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009e50 tx=0x7f23dc023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc019920 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc022980 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec0b4cf0 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc022d60 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec1458a0 con 0x7f23ec0b4880 2023-10-06T03:53:20.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f23dc02d680 con 0x7f23ec0b4880 2023-10-06T03:53:20.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f23dc0377d0 con 0x7f23ec0b4880 2023-10-06T03:53:20.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.595+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec146610 con 0x7f23ec0b4880 2023-10-06T03:53:20.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.599+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f23dc032070 con 0x7f23ec0b4880 2023-10-06T03:53:20.668 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:20.663+0000 7f302fb2a000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:53:20.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:20.659+0000 7f4029267000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:53:20.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.671+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f23ec146610 con 0x7f23ec0b4880 2023-10-06T03:53:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23e3fff700 1 -- 172.21.15.57:0/1787263065 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f23dc027040 con 0x7f23ec0b4880 2023-10-06T03:53:20.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 msgr2=0x7f23ec13aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009e50 tx=0x7f23dc023000 comp rx=0 tx=0).stop 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 shutdown_connections 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23ec134340 0x7f23ec134790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23ec0b4880 0x7f23ec13aa00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 --2- 172.21.15.57:0/1787263065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23cc00fcf0 0x7f23ec146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 >> 172.21.15.57:0/1787263065 conn(0x7f23ec0b5c30 msgr2=0x7f23ec0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 shutdown_connections 2023-10-06T03:53:20.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:20.679+0000 7f23f240a700 1 -- 172.21.15.57:0/1787263065 wait complete. 2023-10-06T03:53:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2023-10-06T03:53:20.696 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:53:20.697 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:20.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:53:20.712 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:20.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:53:20.722 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:20.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:53:20.737 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:53:20.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:53:20.797 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:20.797 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:53:20.813 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:20.813 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:53:20.869 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:20.870 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:53:20.881 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2023-10-06T03:53:20.881 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:53:20.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new a1971618-a85d-4e90-bcf4-a40e7b26c1a8 0 2023-10-06T03:53:20.996 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 Processor -- start 2023-10-06T03:53:20.996 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 -- start start 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36840b2440 0x7f3684145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 0x7f36840ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368406ed00 con 0x7f368406e860 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36840b1da0 con 0x7f36840b2440 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3688a74700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368406e3d0 con 0x7f36840abe10 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36840b2440 0x7f3684145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36840b2440 0x7f3684145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55342/0 (socket says 172.21.15.105:55342) 2023-10-06T03:53:20.999 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 -- 172.21.15.105:0/3496233345 learned_addr learned my addr 172.21.15.105:0/3496233345 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3683fff700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3682ffd700 1 --2- 172.21.15.105:0/3496233345 >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 0x7f36840ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3683fff700 1 -- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f3684067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3683fff700 1 -- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f3684067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3683fff700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3683fff700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 -- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f3684067070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 -- 172.21.15.105:0/3496233345 >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 msgr2=0x7f36840ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 --2- 172.21.15.105:0/3496233345 >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 0x7f36840ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.000 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 -- 172.21.15.105:0/3496233345 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368406dd80 con 0x7f36840b2440 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f3682ffd700 1 --2- 172.21.15.105:0/3496233345 >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 0x7f36840ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36837fe700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f3684145820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f368406c710 tx=0x7f3674009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f17effe84badbc8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36827fc700 1 -- 172.21.15.105:0/3496233345 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400b860 con 0x7f36840b2440 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36827fc700 1 -- 172.21.15.105:0/3496233345 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400b9c0 con 0x7f36840b2440 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.987+0000 7f36827fc700 1 -- 172.21.15.105:0/3496233345 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400bd60 con 0x7f36840b2440 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 msgr2=0x7f3684145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f3684145820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f368406c710 tx=0x7f3674009250 comp rx=0 tx=0).stop 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/3496233345 shutdown_connections 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f3684067070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- 172.21.15.105:0/3496233345 >> v2:172.21.15.57:3300/0 conn(0x7f368406e860 0x7f36840ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- 172.21.15.105:0/3496233345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f3684145820 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.001 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/3496233345 >> 172.21.15.105:0/3496233345 conn(0x7f3684068180 msgr2=0x7f3684068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.002 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/3496233345 shutdown_connections 2023-10-06T03:53:21.002 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/3496233345 wait complete. 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 Processor -- start 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- start start 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f368406e860 0x7f36840ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f36840a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.004 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840af280 con 0x7f368406e860 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36840a8b70 con 0x7f36840b2440 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36840af4a0 con 0x7f36840abe10 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f36840a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:50056/0 (socket says 172.21.15.105:50056) 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 -- 172.21.15.105:0/1682905480 learned_addr learned my addr 172.21.15.105:0/1682905480 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f36837fe700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f368406e860 0x7f36840ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 -- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f36840a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 -- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f36840a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.005 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3682ffd700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 -- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 msgr2=0x7f36840a9000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 -- 172.21.15.105:0/1682905480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f368406e860 msgr2=0x7f36840ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f368406e860 0x7f36840ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 -- 172.21.15.105:0/1682905480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740094f0 con 0x7f36840b2440 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3683fff700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f36840a9540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f367c007e70 tx=0x7f367c0097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c018070 con 0x7f36840b2440 2023-10-06T03:53:21.006 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c00eb70 con 0x7f36840b2440 2023-10-06T03:53:21.007 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36840af780 con 0x7f36840b2440 2023-10-06T03:53:21.007 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.991+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c014420 con 0x7f36840b2440 2023-10-06T03:53:21.007 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.995+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36840a88a0 con 0x7f36840b2440 2023-10-06T03:53:21.007 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.995+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f367c003020 con 0x7f36840b2440 2023-10-06T03:53:21.007 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.995+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f367c01d570 con 0x7f36840b2440 2023-10-06T03:53:21.008 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.995+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36840a8d20 con 0x7f36840b2440 2023-10-06T03:53:21.008 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:20.999+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f36840a8d20 con 0x7f36840b2440 2023-10-06T03:53:21.081 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.071+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a1971618-a85d-4e90-bcf4-a40e7b26c1a8", "id": 0} v 0) v1 -- 0x7f368404b5c0 con 0x7f36840b2440 2023-10-06T03:53:21.093 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.083+0000 7f366b7fe700 1 -- 172.21.15.105:0/1682905480 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1971618-a85d-4e90-bcf4-a40e7b26c1a8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f367c023060 con 0x7f36840b2440 2023-10-06T03:53:21.093 INFO:teuthology.orchestra.run.smithi105.stdout:0 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.083+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 msgr2=0x7f36840a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.083+0000 7f3688a74700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f36840a9540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f367c007e70 tx=0x7f367c0097e0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 shutdown_connections 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36840b2440 0x7f36840a9540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36840abe10 0x7f36840a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 --2- 172.21.15.105:0/1682905480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f368406e860 0x7f36840ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 >> 172.21.15.105:0/1682905480 conn(0x7f3684068180 msgr2=0x7f368413bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 shutdown_connections 2023-10-06T03:53:21.095 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.087+0000 7f3688a74700 1 -- 172.21.15.105:0/1682905480 wait complete. 2023-10-06T03:53:21.109 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new ba8d4308-ce7c-4f0e-b1a1-88f9764e5819 1 2023-10-06T03:53:21.217 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 Processor -- start 2023-10-06T03:53:21.217 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 -- start start 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f444c06c840 0x7f444c0b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f444c143a10 0x7f444c13ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0ae800 con 0x7f444c143a10 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c0b2780 con 0x7f444c06c840 2023-10-06T03:53:21.220 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f4450f31700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0b2130 con 0x7f444c067780 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444affd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f444c06c840 0x7f444c0b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444affd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f444c06c840 0x7f444c0b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55364/0 (socket says 172.21.15.105:55364) 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444affd700 1 -- 172.21.15.105:0/2316688922 learned_addr learned my addr 172.21.15.105:0/2316688922 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444bfff700 1 --2- 172.21.15.105:0/2316688922 >> v2:172.21.15.57:3300/0 conn(0x7f444c143a10 0x7f444c13ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.221 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444b7fe700 1 -- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 msgr2=0x7f444c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:21.222 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444b7fe700 1 -- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 msgr2=0x7f444c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:21.222 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444b7fe700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.222 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.207+0000 7f444b7fe700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 -- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 msgr2=0x7f444c1434d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 -- 172.21.15.105:0/2316688922 >> v2:172.21.15.57:3300/0 conn(0x7f444c143a10 msgr2=0x7f444c13ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- 172.21.15.105:0/2316688922 >> v2:172.21.15.57:3300/0 conn(0x7f444c143a10 0x7f444c13ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 -- 172.21.15.105:0/2316688922 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0b2410 con 0x7f444c06c840 2023-10-06T03:53:21.223 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c06c840 0x7f444c0b0090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44400099b0 tx=0x7f4440009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b60f4a08760cde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444a7fc700 1 -- 172.21.15.105:0/2316688922 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440009ea0 con 0x7f444c06c840 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444a7fc700 1 -- 172.21.15.105:0/2316688922 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000b820 con 0x7f444c06c840 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444a7fc700 1 -- 172.21.15.105:0/2316688922 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000bbc0 con 0x7f444c06c840 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c06c840 msgr2=0x7f444c0b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c06c840 0x7f444c0b0090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44400099b0 tx=0x7f4440009250 comp rx=0 tx=0).stop 2023-10-06T03:53:21.224 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/2316688922 shutdown_connections 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- 172.21.15.105:0/2316688922 >> v2:172.21.15.57:3300/0 conn(0x7f444c143a10 0x7f444c13ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c06c840 0x7f444c0b0090 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- 172.21.15.105:0/2316688922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c067780 0x7f444c1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/2316688922 >> 172.21.15.105:0/2316688922 conn(0x7f444c06b660 msgr2=0x7f444c067070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/2316688922 shutdown_connections 2023-10-06T03:53:21.225 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/2316688922 wait complete. 2023-10-06T03:53:21.228 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 Processor -- start 2023-10-06T03:53:21.228 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- start start 2023-10-06T03:53:21.228 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.228 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f444c0a5580 0x7f444c0a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0a5f40 con 0x7f444c0a5580 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c140180 con 0x7f444c067780 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444c0a50d0 con 0x7f444c143a10 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.229 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55366/0 (socket says 172.21.15.105:55366) 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 -- 172.21.15.105:0/3816982502 learned_addr learned my addr 172.21.15.105:0/3816982502 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444bfff700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f444c0a5580 0x7f444c0a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 -- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 msgr2=0x7f444c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 -- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 msgr2=0x7f444c13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:21.230 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444affd700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 -- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 msgr2=0x7f444c13fc40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 -- 172.21.15.105:0/3816982502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f444c0a5580 msgr2=0x7f444c0a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f444c0a5580 0x7f444c0a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.231 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 -- 172.21.15.105:0/3816982502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400094f0 con 0x7f444c067780 2023-10-06T03:53:21.232 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f444b7fe700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f443c00d840 tx=0x7f443c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.232 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c018070 con 0x7f444c067780 2023-10-06T03:53:21.232 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c005a00 con 0x7f444c067780 2023-10-06T03:53:21.233 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c0a4530 con 0x7f444c067780 2023-10-06T03:53:21.233 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.211+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c005da0 con 0x7f444c067780 2023-10-06T03:53:21.233 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.215+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c0b69d0 con 0x7f444c067780 2023-10-06T03:53:21.234 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.215+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f443c012800 con 0x7f444c067780 2023-10-06T03:53:21.234 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.215+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f443c006240 con 0x7f444c067780 2023-10-06T03:53:21.234 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.215+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c0a5210 con 0x7f444c067780 2023-10-06T03:53:21.234 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.219+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f444c0a5210 con 0x7f444c067780 2023-10-06T03:53:21.289 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.283+0000 7f302fb2a000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:53:21.301 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.291+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba8d4308-ce7c-4f0e-b1a1-88f9764e5819", "id": 1} v 0) v1 -- 0x7f444c04b5c0 con 0x7f444c067780 2023-10-06T03:53:21.311 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f44337fe700 1 -- 172.21.15.105:0/3816982502 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba8d4308-ce7c-4f0e-b1a1-88f9764e5819", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f443c012bf0 con 0x7f444c067780 2023-10-06T03:53:21.312 INFO:teuthology.orchestra.run.smithi105.stdout:1 2023-10-06T03:53:21.313 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4029267000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 msgr2=0x7f444c0ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f443c00d840 tx=0x7f443c008040 comp rx=0 tx=0).stop 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 shutdown_connections 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f444c0a5580 0x7f444c0a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f444c143a10 0x7f444c13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.315 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 --2- 172.21.15.105:0/3816982502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f444c067780 0x7f444c0ad350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.316 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 >> 172.21.15.105:0/3816982502 conn(0x7f444c06b660 msgr2=0x7f444c0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.316 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 shutdown_connections 2023-10-06T03:53:21.316 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.303+0000 7f4450f31700 1 -- 172.21.15.105:0/3816982502 wait complete. 2023-10-06T03:53:21.331 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new a7670c23-0f37-4d78-a44a-645b23a963bd 2 2023-10-06T03:53:21.348 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.343+0000 7f302fb2a000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:53:21.372 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.363+0000 7f4029267000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:53:21.437 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 Processor -- start 2023-10-06T03:53:21.437 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 -- start start 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac2c06cc60 0x7fac2c138830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c06ddb0 con 0x7fac2c06d670 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c13f850 con 0x7fac2c06cc60 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac33191700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c13fb30 con 0x7fac2c0b0c00 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3198e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac2c06cc60 0x7fac2c138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.439 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3218f700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fac2c06d670 0x7fac2c0b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:43014/0 (socket says 172.21.15.105:43014) 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:50092/0 (socket says 172.21.15.105:50092) 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3218f700 1 -- 172.21.15.105:0/3864694561 learned_addr learned my addr 172.21.15.105:0/3864694561 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 -- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 msgr2=0x7fac2c138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 -- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 msgr2=0x7fac2c138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac32990700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.440 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3118d700 1 -- 172.21.15.105:0/3864694561 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948234747 0 0) 0x7fac2c06ddb0 con 0x7fac2c06d670 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3198e700 1 -- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 msgr2=0x7fac2c138d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3198e700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3198e700 1 -- 172.21.15.105:0/3864694561 >> v1:172.21.15.105:6789/0 conn(0x7fac2c06d670 legacy=0x7fac2c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.427+0000 7fac3198e700 1 -- 172.21.15.105:0/3864694561 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c13fea0 con 0x7fac2c06cc60 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac3198e700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06cc60 0x7fac2c138830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0098e0 tx=0x7fac1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9655e3b76887b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac3118d700 1 -- 172.21.15.105:0/3864694561 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c009e80 con 0x7fac2c06cc60 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac3118d700 1 -- 172.21.15.105:0/3864694561 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c00b860 con 0x7fac2c06cc60 2023-10-06T03:53:21.441 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac3118d700 1 -- 172.21.15.105:0/3864694561 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00bbe0 con 0x7fac2c06cc60 2023-10-06T03:53:21.447 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06cc60 msgr2=0x7fac2c138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.447 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06cc60 0x7fac2c138830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac1c0098e0 tx=0x7fac1c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.447 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- 172.21.15.105:0/3864694561 shutdown_connections 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c0b0c00 0x7fac2c138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 --2- 172.21.15.105:0/3864694561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06cc60 0x7fac2c138830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- 172.21.15.105:0/3864694561 >> 172.21.15.105:0/3864694561 conn(0x7fac2c068180 msgr2=0x7fac2c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- 172.21.15.105:0/3864694561 shutdown_connections 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- 172.21.15.105:0/3864694561 wait complete. 2023-10-06T03:53:21.448 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 Processor -- start 2023-10-06T03:53:21.449 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 -- start start 2023-10-06T03:53:21.449 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.431+0000 7fac33191700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.449 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.449 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac2c0b0c00 0x7fac2c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.449 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c140a50 con 0x7fac2c0b0c00 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c140590 con 0x7fac2c06d670 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14e930 con 0x7fac2c06cc60 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55392/0 (socket says 172.21.15.105:55392) 2023-10-06T03:53:21.450 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:50102/0 (socket says 172.21.15.105:50102) 2023-10-06T03:53:21.451 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 -- 172.21.15.105:0/1991525250 learned_addr learned my addr 172.21.15.105:0/1991525250 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.451 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 -- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 msgr2=0x7fac2c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:21.451 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 -- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 msgr2=0x7fac2c0aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:21.451 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.451 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac32990700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac2c0b0c00 0x7fac2c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.452 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3218f700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.452 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 -- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 msgr2=0x7fac2c0aea80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:21.452 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.452 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 -- 172.21.15.105:0/1991525250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac2c0b0c00 msgr2=0x7fac2c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.452 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac2c0b0c00 0x7fac2c14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 -- 172.21.15.105:0/1991525250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009420 con 0x7fac2c06d670 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac3198e700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0acb50 tx=0x7fac1c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00bbe0 con 0x7fac2c06d670 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c011420 con 0x7fac2c06d670 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c13ae50 con 0x7fac2c06d670 2023-10-06T03:53:21.453 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0117c0 con 0x7fac2c06d670 2023-10-06T03:53:21.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c13b1e0 con 0x7fac2c06d670 2023-10-06T03:53:21.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fac1c011bb0 con 0x7fac2c06d670 2023-10-06T03:53:21.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fac1c023820 con 0x7fac2c06d670 2023-10-06T03:53:21.454 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.435+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c06c460 con 0x7fac2c06d670 2023-10-06T03:53:21.455 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.439+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fac1c028070 con 0x7fac2c06d670 2023-10-06T03:53:21.467 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.463+0000 7f302fb2a000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:53:21.489 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.479+0000 7f4029267000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:53:21.521 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.511+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7670c23-0f37-4d78-a44a-645b23a963bd", "id": 2} v 0) v1 -- 0x7fac2c06da80 con 0x7fac2c06d670 2023-10-06T03:53:21.532 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac227fc700 1 -- 172.21.15.105:0/1991525250 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7670c23-0f37-4d78-a44a-645b23a963bd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac1c015020 con 0x7fac2c06d670 2023-10-06T03:53:21.533 INFO:teuthology.orchestra.run.smithi105.stdout:2 2023-10-06T03:53:21.534 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 msgr2=0x7fac2c140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0acb50 tx=0x7fac1c017000 comp rx=0 tx=0).stop 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 shutdown_connections 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac2c0b0c00 0x7fac2c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac2c06d670 0x7fac2c140050 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 --2- 172.21.15.105:0/1991525250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac2c06cc60 0x7fac2c0aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 >> 172.21.15.105:0/1991525250 conn(0x7fac2c068180 msgr2=0x7fac2c068550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.535 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 shutdown_connections 2023-10-06T03:53:21.536 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.523+0000 7fac33191700 1 -- 172.21.15.105:0/1991525250 wait complete. 2023-10-06T03:53:21.546 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new f222cd48-36bc-4186-8013-deaae218e33c 3 2023-10-06T03:53:21.691 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 Processor -- start 2023-10-06T03:53:21.691 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- start start 2023-10-06T03:53:21.699 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2fa006d4c0 0x7f2fa00ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fa00ae960 0x7f2fa01497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00af210 con 0x7f2fa00701c0 2023-10-06T03:53:21.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa006ecd0 con 0x7f2fa00ae960 2023-10-06T03:53:21.700 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa006cfe0 con 0x7f2fa006d4c0 2023-10-06T03:53:21.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2fa006d4c0 0x7f2fa00ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2fa006d4c0 0x7f2fa00ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55408/0 (socket says 172.21.15.105:55408) 2023-10-06T03:53:21.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 -- 172.21.15.105:0/1668517880 learned_addr learned my addr 172.21.15.105:0/1668517880 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa605c700 1 --2- 172.21.15.105:0/1668517880 >> v2:172.21.15.57:3300/0 conn(0x7f2fa00ae960 0x7f2fa01497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.701 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 -- 172.21.15.105:0/1668517880 >> v2:172.21.15.57:3300/0 conn(0x7f2fa00ae960 msgr2=0x7f2fa01497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:21.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 --2- 172.21.15.105:0/1668517880 >> v2:172.21.15.57:3300/0 conn(0x7f2fa00ae960 0x7f2fa01497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 -- 172.21.15.105:0/1668517880 >> v1:172.21.15.57:6789/0 conn(0x7f2fa00701c0 legacy=0x7f2fa013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 -- 172.21.15.105:0/1668517880 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa006e560 con 0x7f2fa006d4c0 2023-10-06T03:53:21.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa505a700 1 --2- 172.21.15.105:0/1668517880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa006d4c0 0x7f2fa00ae420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00688c0 tx=0x7f2f90009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2a7f17015452ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.702 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa4859700 1 -- 172.21.15.105:0/1668517880 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000b860 con 0x7f2fa006d4c0 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa4859700 1 -- 172.21.15.105:0/1668517880 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000b9c0 con 0x7f2fa006d4c0 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa4859700 1 -- 172.21.15.105:0/1668517880 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000bd60 con 0x7f2fa006d4c0 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- 172.21.15.105:0/1668517880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa006d4c0 msgr2=0x7f2fa00ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 --2- 172.21.15.105:0/1668517880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa006d4c0 0x7f2fa00ae420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00688c0 tx=0x7f2f90009250 comp rx=0 tx=0).stop 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- 172.21.15.105:0/1668517880 shutdown_connections 2023-10-06T03:53:21.703 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 --2- 172.21.15.105:0/1668517880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa006d4c0 0x7f2fa00ae420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.704 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 --2- 172.21.15.105:0/1668517880 >> v2:172.21.15.57:3300/0 conn(0x7f2fa00ae960 0x7f2fa01497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.704 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- 172.21.15.105:0/1668517880 >> 172.21.15.105:0/1668517880 conn(0x7f2fa00b1a90 msgr2=0x7f2fa00b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.704 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- 172.21.15.105:0/1668517880 shutdown_connections 2023-10-06T03:53:21.704 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.683+0000 7f2fa685d700 1 -- 172.21.15.105:0/1668517880 wait complete. 2023-10-06T03:53:21.704 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 Processor -- start 2023-10-06T03:53:21.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- start start 2023-10-06T03:53:21.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa006d4c0 0x7f2fa013b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.705 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00aab00 con 0x7f2fa006d4c0 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00aaf20 con 0x7f2fa00701c0 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00a9140 con 0x7f2fa00ae960 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa605c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55424/0 (socket says 172.21.15.105:55424) 2023-10-06T03:53:21.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 -- 172.21.15.105:0/4233751037 learned_addr learned my addr 172.21.15.105:0/4233751037 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa585b700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa006d4c0 0x7f2fa013b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa605c700 1 -- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 msgr2=0x7f2fa0137300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-10-06T03:53:21.707 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa605c700 1 -- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 msgr2=0x7f2fa0137300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:21.708 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa605c700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.708 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa605c700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.708 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 -- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 msgr2=0x7f2fa0137300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:21.708 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 -- 172.21.15.105:0/4233751037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa006d4c0 msgr2=0x7f2fa013b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa006d4c0 0x7f2fa013b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 -- 172.21.15.105:0/4233751037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900094f0 con 0x7f2fa00701c0 2023-10-06T03:53:21.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa505a700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00b2820 tx=0x7f2f90017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.709 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90011e60 con 0x7f2fa00701c0 2023-10-06T03:53:21.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9001a630 con 0x7f2fa00701c0 2023-10-06T03:53:21.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9001a9f0 con 0x7f2fa00701c0 2023-10-06T03:53:21.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa00ab260 con 0x7f2fa00701c0 2023-10-06T03:53:21.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa00adf70 con 0x7f2fa00701c0 2023-10-06T03:53:21.710 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2f9002d6c0 con 0x7f2fa00701c0 2023-10-06T03:53:21.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f2f9001ada0 con 0x7f2fa00701c0 2023-10-06T03:53:21.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.687+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa00a88a0 con 0x7f2fa00701c0 2023-10-06T03:53:21.711 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.691+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2f90015020 con 0x7f2fa00701c0 2023-10-06T03:53:21.712 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.703+0000 7f4029267000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:53:21.713 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.707+0000 7f302fb2a000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:53:21.760 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.751+0000 7f4029267000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:53:21.767 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.763+0000 7f302fb2a000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:53:21.774 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.763+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f222cd48-36bc-4186-8013-deaae218e33c", "id": 3} v 0) v1 -- 0x7f2fa00a8e20 con 0x7f2fa00701c0 2023-10-06T03:53:21.785 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.775+0000 7f2f95ffb700 1 -- 172.21.15.105:0/4233751037 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f222cd48-36bc-4186-8013-deaae218e33c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f9002d970 con 0x7f2fa00701c0 2023-10-06T03:53:21.785 INFO:teuthology.orchestra.run.smithi105.stdout:3 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.775+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 msgr2=0x7f2fa0155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.775+0000 7f2fa685d700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00b2820 tx=0x7f2f90017000 comp rx=0 tx=0).stop 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 shutdown_connections 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2fa00ae960 0x7f2fa0137300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fa00701c0 0x7f2fa0155330 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 --2- 172.21.15.105:0/4233751037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fa006d4c0 0x7f2fa013b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 >> 172.21.15.105:0/4233751037 conn(0x7f2fa00b1a90 msgr2=0x7f2fa00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 shutdown_connections 2023-10-06T03:53:21.787 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.779+0000 7f2fa685d700 1 -- 172.21.15.105:0/4233751037 wait complete. 2023-10-06T03:53:21.803 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new d8f7fb55-f4fe-4554-a643-251915fb300e 4 2023-10-06T03:53:21.903 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 Processor -- start 2023-10-06T03:53:21.903 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 -- start start 2023-10-06T03:53:21.904 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbb00701c0 0x7fbbb00af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.904 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00b0b20 con 0x7fbbb01436a0 2023-10-06T03:53:21.904 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb0067e90 con 0x7fbbb0143b20 2023-10-06T03:53:21.904 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb01445d0 con 0x7fbbb00701c0 2023-10-06T03:53:21.904 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaf7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbbb0143b20 0x7fbbb0067780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:43020/0 (socket says 172.21.15.105:43020) 2023-10-06T03:53:21.905 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaf7fe700 1 -- 172.21.15.105:0/2931523216 learned_addr learned my addr 172.21.15.105:0/2931523216 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:53:21.905 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaeffd700 1 --2- 172.21.15.105:0/2931523216 >> v2:172.21.15.57:3300/0 conn(0x7fbbb00701c0 0x7fbbb00af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.906 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbae7fc700 1 -- 172.21.15.105:0/2931523216 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253226540 0 0) 0x7fbbb0067e90 con 0x7fbbb0143b20 2023-10-06T03:53:21.906 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbae7fc700 1 -- 172.21.15.105:0/2931523216 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c003570 con 0x7fbbb0143b20 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2931523216 >> v1:172.21.15.105:6789/0 conn(0x7fbbb0143b20 legacy=0x7fbbb0067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2931523216 >> v1:172.21.15.57:6789/0 conn(0x7fbbb01436a0 legacy=0x7fbbb0067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2931523216 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00ac880 con 0x7fbbb00701c0 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaeffd700 1 --2- 172.21.15.105:0/2931523216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb00701c0 0x7fbbb00af990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbba00098d0 tx=0x7fbba0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d6e1f9f1c40c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbae7fc700 1 -- 172.21.15.105:0/2931523216 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0005c10 con 0x7fbbb00701c0 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbae7fc700 1 -- 172.21.15.105:0/2931523216 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0005d70 con 0x7fbbb00701c0 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbae7fc700 1 -- 172.21.15.105:0/2931523216 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0006280 con 0x7fbbb00701c0 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.895+0000 7fbbaffff700 1 -- 172.21.15.105:0/2931523216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb00701c0 msgr2=0x7fbbb00af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2931523216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb00701c0 0x7fbbb00af990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbba00098d0 tx=0x7fbba0009120 comp rx=0 tx=0).stop 2023-10-06T03:53:21.907 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- 172.21.15.105:0/2931523216 shutdown_connections 2023-10-06T03:53:21.908 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2931523216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb00701c0 0x7fbbb00af990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.908 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- 172.21.15.105:0/2931523216 >> 172.21.15.105:0/2931523216 conn(0x7fbbb00b1a90 msgr2=0x7fbbb00b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.908 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- 172.21.15.105:0/2931523216 shutdown_connections 2023-10-06T03:53:21.908 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- 172.21.15.105:0/2931523216 wait complete. 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 Processor -- start 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- start start 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 0x7fbbb0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb0143b20 0x7fbbb0150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:21.911 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb014ffd0 con 0x7fbbb0143b20 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00a5670 con 0x7fbbb01436a0 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00a6b80 con 0x7fbbb00701c0 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 0x7fbbb0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:50116/0 (socket says 172.21.15.105:50116) 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2272499053 learned_addr learned my addr 172.21.15.105:0/2272499053 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 msgr2=0x7fbbb00a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 -- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 msgr2=0x7fbbb00a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaf7fe700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb0143b20 0x7fbbb0150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaeffd700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:21.912 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 -- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 msgr2=0x7fbbb00a5130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 -- 172.21.15.105:0/2272499053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb0143b20 msgr2=0x7fbbb0150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb0143b20 0x7fbbb0150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 -- 172.21.15.105:0/2272499053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00093c0 con 0x7fbbb01436a0 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba7fff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 0x7fbbb0150400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c590 tx=0x7fbb98007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98011590 con 0x7fbbb01436a0 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98011710 con 0x7fbbb01436a0 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb00a6e60 con 0x7fbbb01436a0 2023-10-06T03:53:21.913 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.899+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98011ad0 con 0x7fbbb01436a0 2023-10-06T03:53:21.914 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.903+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00a5890 con 0x7fbbb01436a0 2023-10-06T03:53:21.914 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.903+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbb9801c6c0 con 0x7fbbb01436a0 2023-10-06T03:53:21.914 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.903+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fbb98012420 con 0x7fbbb01436a0 2023-10-06T03:53:21.914 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.903+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0150120 con 0x7fbbb01436a0 2023-10-06T03:53:21.915 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.907+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbbb0150120 con 0x7fbbb01436a0 2023-10-06T03:53:21.945 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.935+0000 7f4029267000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:53:21.965 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:21.959+0000 7f302fb2a000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:53:21.985 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.975+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8f7fb55-f4fe-4554-a643-251915fb300e", "id": 4} v 0) v1 -- 0x7fbbb00acc50 con 0x7fbbb01436a0 2023-10-06T03:53:21.994 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.983+0000 7fbba6ffd700 1 -- 172.21.15.105:0/2272499053 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8f7fb55-f4fe-4554-a643-251915fb300e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb98017070 con 0x7fbbb01436a0 2023-10-06T03:53:21.994 INFO:teuthology.orchestra.run.smithi105.stdout:4 2023-10-06T03:53:21.996 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 msgr2=0x7fbbb0150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:21.996 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 0x7fbbb0150400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c590 tx=0x7fbb98007ec0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 shutdown_connections 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbb0143b20 0x7fbbb0150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbb01436a0 0x7fbbb0150400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 --2- 172.21.15.105:0/2272499053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbb00701c0 0x7fbbb00a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 >> 172.21.15.105:0/2272499053 conn(0x7fbbb00b1a90 msgr2=0x7fbbb013d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 shutdown_connections 2023-10-06T03:53:21.997 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:21.987+0000 7fbbaffff700 1 -- 172.21.15.105:0/2272499053 wait complete. 2023-10-06T03:53:22.006 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:21.995+0000 7f4029267000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:53:22.011 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 14a82b3e-2874-4263-8228-c2442b95e456 5 2023-10-06T03:53:22.034 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:22.031+0000 7f302fb2a000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:53:22.069 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:22.059+0000 7f4029267000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:53:22.101 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:22.095+0000 7f302fb2a000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:53:22.108 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 Processor -- start 2023-10-06T03:53:22.108 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 -- start start 2023-10-06T03:53:22.114 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f159c1399e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f159c0b06d0 0x7f159c139f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0b1730 con 0x7f159c06f010 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c067e90 con 0x7f159c0b06d0 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f15a0b6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0b10e0 con 0x7f159c1409c0 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159b7fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f159c06f010 0x7f159c1402b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:43030/0 (socket says 172.21.15.105:43030) 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159b7fe700 1 -- 172.21.15.105:0/1977526005 learned_addr learned my addr 172.21.15.105:0/1977526005 (peer_addr_for_me v1:172.21.15.105:0/0) 2023-10-06T03:53:22.115 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f159c1399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159bfff700 1 --2- 172.21.15.105:0/1977526005 >> v2:172.21.15.57:3300/0 conn(0x7f159c0b06d0 0x7f159c139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f1593fff700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f159c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f1593fff700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f159c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f159c1399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207380105 0 0) 0x7f159c0b1730 con 0x7f159c06f010 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f159c1399e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1588003570 con 0x7f159c06f010 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920815269 0 0) 0x7f1588003570 con 0x7f159c06f010 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f159c1399e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f159c1399e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.116 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 >> v2:172.21.15.57:3300/0 conn(0x7f159c0b06d0 msgr2=0x7f159c139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 --2- 172.21.15.105:0/1977526005 >> v2:172.21.15.57:3300/0 conn(0x7f159c0b06d0 0x7f159c139f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0b13c0 con 0x7f159c06f010 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.099+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f158c001470 con 0x7f159c06f010 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 >> v1:172.21.15.105:6789/0 conn(0x7f159c06f010 legacy=0x7f159c1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f1588003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1588003fe0 0x7f1588004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1588004d50 0x7f15880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c067e90 con 0x7f1588004d50 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0b10e0 con 0x7f1588003fe0 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158800bb40 con 0x7f159c1409c0 2023-10-06T03:53:22.117 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159b7fe700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f1588003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1588003fe0 0x7f1588004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159b7fe700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f1588003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159b7fe700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f1588003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159b7fe700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f1588003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159b7fe700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f1588003a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159bfff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1588004d50 0x7f15880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 msgr2=0x7f1588003a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f159c1409c0 0x7f1588003a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1588004d50 msgr2=0x7f15880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:22.118 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1588004d50 0x7f15880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 -- 172.21.15.105:0/1977526005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1588003570 con 0x7f1588003fe0 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159bfff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1588004d50 0x7f15880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f1593fff700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1588003fe0 0x7f1588004810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1584006f30 tx=0x7f1584008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bac39cf215f491d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1584018070 con 0x7f1588003fe0 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158400d5d0 con 0x7f1588003fe0 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159affd700 1 -- 172.21.15.105:0/1977526005 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158400d990 con 0x7f1588003fe0 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1588003fe0 msgr2=0x7f1588004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 --2- 172.21.15.105:0/1977526005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1588003fe0 0x7f1588004810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1584006f30 tx=0x7f1584008040 comp rx=0 tx=0).stop 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f159bfff700 1 -- 172.21.15.105:0/1977526005 reap_dead start 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1977526005 shutdown_connections 2023-10-06T03:53:22.119 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1977526005 >> 172.21.15.105:0/1977526005 conn(0x7f159c068180 msgr2=0x7f159c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.120 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1977526005 shutdown_connections 2023-10-06T03:53:22.120 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1977526005 wait complete. 2023-10-06T03:53:22.120 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 Processor -- start 2023-10-06T03:53:22.120 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.103+0000 7f15a0b6e700 1 -- start start 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f159c154480 0x7f159c13c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 0x7f159c0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0a4650 con 0x7f159c13d910 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c13c600 con 0x7f159c154480 2023-10-06T03:53:22.122 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c1539a0 con 0x7f1588003fe0 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:50152/0 (socket says 172.21.15.105:50152) 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 -- 172.21.15.105:0/1863682161 learned_addr learned my addr 172.21.15.105:0/1863682161 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f1593fff700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f159c154480 0x7f159c13c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 0x7f159c0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 -- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 msgr2=0x7f159c0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 -- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 msgr2=0x7f159c0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159b7fe700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 -- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 msgr2=0x7f159c0b5a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:22.123 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 -- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f159c154480 msgr2=0x7f159c13c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f159c154480 0x7f159c13c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 -- 172.21.15.105:0/1863682161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c153c80 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f159bfff700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 0x7f159c0abbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f159c0b0aa0 tx=0x7f159400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400e050 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400f040 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c153f60 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594010df0 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c0b6090 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1594003020 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1594015650 con 0x7f159c13d910 2023-10-06T03:53:22.124 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.107+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c06c460 con 0x7f159c13d910 2023-10-06T03:53:22.125 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.115+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f159401a030 con 0x7f159c13d910 2023-10-06T03:53:22.197 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.188+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14a82b3e-2874-4263-8228-c2442b95e456", "id": 5} v 0) v1 -- 0x7f159c0afbe0 con 0x7f159c13d910 2023-10-06T03:53:22.206 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.196+0000 7f15937fe700 1 -- 172.21.15.105:0/1863682161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14a82b3e-2874-4263-8228-c2442b95e456", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1594015ba0 con 0x7f159c13d910 2023-10-06T03:53:22.206 INFO:teuthology.orchestra.run.smithi105.stdout:5 2023-10-06T03:53:22.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 msgr2=0x7f159c0abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.207 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 0x7f159c0abbd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f159c0b0aa0 tx=0x7f159400b040 comp rx=0 tx=0).stop 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 shutdown_connections 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f159c13d910 0x7f159c0abbd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f159c154480 0x7f159c13c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 --2- 172.21.15.105:0/1863682161 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1588003fe0 0x7f159c0b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 >> 172.21.15.105:0/1863682161 conn(0x7f159c068180 msgr2=0x7f159c13f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 shutdown_connections 2023-10-06T03:53:22.208 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.200+0000 7f15a0b6e700 1 -- 172.21.15.105:0/1863682161 wait complete. 2023-10-06T03:53:22.220 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 3b2d5de7-16be-4748-80a6-f92a73a84853 6 2023-10-06T03:53:22.324 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 Processor -- start 2023-10-06T03:53:22.324 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- start start 2023-10-06T03:53:22.332 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37740abfe0 0x7f3774145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406e3d0 con 0x7f37740b2440 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377406ed00 con 0x7f37740abfe0 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740b1da0 con 0x7f377406e860 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37740abfe0 0x7f3774145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37740abfe0 0x7f3774145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55468/0 (socket says 172.21.15.105:55468) 2023-10-06T03:53:22.333 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f377896f700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f37740b2440 0x7f37740ab8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:43044/0 (socket says 172.21.15.105:43044) 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 -- 172.21.15.105:0/4170979554 learned_addr learned my addr 172.21.15.105:0/4170979554 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779170700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779170700 1 -- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f377414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779170700 1 -- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f377414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779170700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.334 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779170700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 -- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f377414cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:22.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 -- 172.21.15.105:0/4170979554 >> v1:172.21.15.105:6789/0 conn(0x7f37740b2440 legacy=0x7f37740ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 -- 172.21.15.105:0/4170979554 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377406dd80 con 0x7f37740abfe0 2023-10-06T03:53:22.335 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3773fff700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f3774145820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37600099b0 tx=0x7f3760009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a88bff9c5c5e024 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f37737fe700 1 -- 172.21.15.105:0/4170979554 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000b860 con 0x7f37740abfe0 2023-10-06T03:53:22.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f37737fe700 1 -- 172.21.15.105:0/4170979554 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376000b9c0 con 0x7f37740abfe0 2023-10-06T03:53:22.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f37737fe700 1 -- 172.21.15.105:0/4170979554 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000bd60 con 0x7f37740abfe0 2023-10-06T03:53:22.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 msgr2=0x7f3774145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.336 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f3774145820 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37600099b0 tx=0x7f3760009250 comp rx=0 tx=0).stop 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- 172.21.15.105:0/4170979554 shutdown_connections 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f377414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 --2- 172.21.15.105:0/4170979554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f3774145820 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.316+0000 7f3779971700 1 -- 172.21.15.105:0/4170979554 >> 172.21.15.105:0/4170979554 conn(0x7f3774068180 msgr2=0x7f3774068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- 172.21.15.105:0/4170979554 shutdown_connections 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- 172.21.15.105:0/4170979554 wait complete. 2023-10-06T03:53:22.337 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 Processor -- start 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- start start 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37740b2440 0x7f37740a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740a8c10 con 0x7f37740b2440 2023-10-06T03:53:22.338 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740ab4e0 con 0x7f37740abfe0 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740a88a0 con 0x7f377406e860 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f377896f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55478/0 (socket says 172.21.15.105:55478) 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 -- 172.21.15.105:0/982275014 learned_addr learned my addr 172.21.15.105:0/982275014 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:22.339 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f377896f700 1 -- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f3774151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f377896f700 1 -- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f3774151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f377896f700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779170700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37740b2440 0x7f37740a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f377896f700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 -- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 msgr2=0x7f3774151d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:22.340 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 -- 172.21.15.105:0/982275014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37740b2440 msgr2=0x7f37740a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37740b2440 0x7f37740a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 -- 172.21.15.105:0/982275014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600094f0 con 0x7f37740abfe0 2023-10-06T03:53:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3773fff700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3760009fd0 tx=0x7f3760017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760024440 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600245a0 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774152af0 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760024920 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774152250 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3760024d50 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.320+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f37600233e0 con 0x7f37740abfe0 2023-10-06T03:53:22.342 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.324+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540052b0 con 0x7f37740abfe0 2023-10-06T03:53:22.343 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.328+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3760015020 con 0x7f37740abfe0 2023-10-06T03:53:22.410 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.400+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b2d5de7-16be-4748-80a6-f92a73a84853", "id": 6} v 0) v1 -- 0x7f3754005600 con 0x7f37740abfe0 2023-10-06T03:53:22.419 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3770ff9700 1 -- 172.21.15.105:0/982275014 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b2d5de7-16be-4748-80a6-f92a73a84853", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3760006d70 con 0x7f37740abfe0 2023-10-06T03:53:22.420 INFO:teuthology.orchestra.run.smithi105.stdout:6 2023-10-06T03:53:22.421 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 msgr2=0x7f37740a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.421 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3760009fd0 tx=0x7f3760017000 comp rx=0 tx=0).stop 2023-10-06T03:53:22.421 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 shutdown_connections 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37740b2440 0x7f37740a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37740abfe0 0x7f37740a90a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 --2- 172.21.15.105:0/982275014 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f377406e860 0x7f3774151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 >> 172.21.15.105:0/982275014 conn(0x7f3774068180 msgr2=0x7f37740677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 shutdown_connections 2023-10-06T03:53:22.422 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.412+0000 7f3779971700 1 -- 172.21.15.105:0/982275014 wait complete. 2023-10-06T03:53:22.434 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new b833428f-23d0-4319-9db7-2901dd5895ae 7 2023-10-06T03:53:22.482 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:22.472+0000 7f4029267000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:53:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 Processor -- start 2023-10-06T03:53:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 -- start start 2023-10-06T03:53:22.536 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f933c0b0440 0x7f933c0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.536 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f933c0adb90 0x7f933c142560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.536 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0aea50 con 0x7f933c142aa0 2023-10-06T03:53:22.536 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c0b1f20 con 0x7f933c0adb90 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f934239a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c142f00 con 0x7f933c0b0440 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f933c0b0440 0x7f933c0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f933c0b0440 0x7f933c0b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43036/0 (socket says 172.21.15.105:43036) 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 -- 172.21.15.105:0/157477639 learned_addr learned my addr 172.21.15.105:0/157477639 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9340b97700 1 --2- 172.21.15.105:0/157477639 >> v2:172.21.15.57:3300/0 conn(0x7f933c0adb90 0x7f933c142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 -- 172.21.15.105:0/157477639 >> v2:172.21.15.57:3300/0 conn(0x7f933c0adb90 msgr2=0x7f933c142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 --2- 172.21.15.105:0/157477639 >> v2:172.21.15.57:3300/0 conn(0x7f933c0adb90 0x7f933c142560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 -- 172.21.15.105:0/157477639 >> v1:172.21.15.57:6789/0 conn(0x7f933c142aa0 legacy=0x7f933c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.524+0000 7f9341398700 1 -- 172.21.15.105:0/157477639 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0b1860 con 0x7f933c0b0440 2023-10-06T03:53:22.537 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 --2- 172.21.15.105:0/157477639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c0b1190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f933c06a1f0 tx=0x7f9338009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f5c7914c2e9bcd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9333fff700 1 -- 172.21.15.105:0/157477639 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338009e70 con 0x7f933c0b0440 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9333fff700 1 -- 172.21.15.105:0/157477639 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800b860 con 0x7f933c0b0440 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9333fff700 1 -- 172.21.15.105:0/157477639 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800bc20 con 0x7f933c0b0440 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/157477639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 msgr2=0x7f933c0b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- 172.21.15.105:0/157477639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c0b1190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f933c06a1f0 tx=0x7f9338009250 comp rx=0 tx=0).stop 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/157477639 shutdown_connections 2023-10-06T03:53:22.538 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- 172.21.15.105:0/157477639 >> v2:172.21.15.57:3300/0 conn(0x7f933c0adb90 0x7f933c142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.539 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- 172.21.15.105:0/157477639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c0b1190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.539 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/157477639 >> 172.21.15.105:0/157477639 conn(0x7f933c067070 msgr2=0x7f933c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.539 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/157477639 shutdown_connections 2023-10-06T03:53:22.539 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/157477639 wait complete. 2023-10-06T03:53:22.541 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:22.535+0000 7f302fb2a000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:53:22.547 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 Processor -- start 2023-10-06T03:53:22.547 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- start start 2023-10-06T03:53:22.547 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.547 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c142aa0 0x7f933c13c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c13a430 con 0x7f933c142aa0 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c156090 con 0x7f933c0b0440 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c156370 con 0x7f933c0adb90 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43042/0 (socket says 172.21.15.105:43042) 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 -- 172.21.15.105:0/1286460628 learned_addr learned my addr 172.21.15.105:0/1286460628 (peer_addr_for_me v2:172.21.15.105:0/0) 2023-10-06T03:53:22.548 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341b99700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c142aa0 0x7f933c13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 -- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 msgr2=0x7f933c141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 -- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 msgr2=0x7f933c141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9341398700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 -- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 msgr2=0x7f933c141960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 -- 172.21.15.105:0/1286460628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c142aa0 msgr2=0x7f933c13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c142aa0 0x7f933c13c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 -- 172.21.15.105:0/1286460628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380094f0 con 0x7f933c0b0440 2023-10-06T03:53:22.549 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f9340b97700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ec80 tx=0x7f932c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00c850 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00c9b0 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c156650 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00cd70 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.528+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c1362c0 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.532+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c06b3a0 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.532+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f932c005c80 con 0x7f933c0b0440 2023-10-06T03:53:22.550 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.532+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f932c013c70 con 0x7f933c0b0440 2023-10-06T03:53:22.551 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.536+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f932c03b6d0 con 0x7f933c0b0440 2023-10-06T03:53:22.595 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:22.588+0000 7f4029267000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:53:22.614 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.604+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b833428f-23d0-4319-9db7-2901dd5895ae", "id": 7} v 0) v1 -- 0x7f933c0b1b40 con 0x7f933c0b0440 2023-10-06T03:53:22.623 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f93317fa700 1 -- 172.21.15.105:0/1286460628 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b833428f-23d0-4319-9db7-2901dd5895ae", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f932c02a070 con 0x7f933c0b0440 2023-10-06T03:53:22.623 INFO:teuthology.orchestra.run.smithi105.stdout:7 2023-10-06T03:53:22.625 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 msgr2=0x7f933c13bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.626 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ec80 tx=0x7f932c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.626 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 shutdown_connections 2023-10-06T03:53:22.626 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f933c142aa0 0x7f933c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.626 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f933c0b0440 0x7f933c13bff0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.626 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 --2- 172.21.15.105:0/1286460628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f933c0adb90 0x7f933c141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.627 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 >> 172.21.15.105:0/1286460628 conn(0x7f933c067070 msgr2=0x7f933c0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.627 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 shutdown_connections 2023-10-06T03:53:22.627 INFO:teuthology.orchestra.run.smithi105.stderr:2023-10-06T03:53:22.616+0000 7f934239a700 1 -- 172.21.15.105:0/1286460628 wait complete. 2023-10-06T03:53:22.637 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:53:22.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:53:22.640 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:53:22.640 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:53:22.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:53:22.642 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:53:22.643 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:53:22.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:53:22.645 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:53:22.645 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:53:22.645 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:53:22.648 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:53:22.649 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:53:22.649 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:53:22.651 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:53:22.651 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:53:22.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:53:22.653 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:53:22.653 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:53:22.653 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:53:22.655 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:53:22.655 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:53:22.656 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:53:22.659 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:53:22.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:22.667 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:22.663+0000 7f302fb2a000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:53:22.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 Processor -- start 2023-10-06T03:53:22.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 -- start start 2023-10-06T03:53:22.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 0x7f784013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f784013e330 0x7f784013e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78400abdd0 con 0x7f78400701c0 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78400aeab0 con 0x7f7840142bf0 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f7844b8a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784006e280 con 0x7f784013e330 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 0x7f784013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 0x7f784013ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48972/0 (socket says 172.21.15.57:48972) 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783effd700 1 -- 172.21.15.57:0/1881701978 learned_addr learned my addr 172.21.15.57:0/1881701978 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:22.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 --2- 172.21.15.57:0/1881701978 >> v2:172.21.15.105:3300/0 conn(0x7f784013e330 0x7f784013e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 -- 172.21.15.57:0/1881701978 >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 msgr2=0x7f784013ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 --2- 172.21.15.57:0/1881701978 >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 0x7f784013ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 -- 172.21.15.57:0/1881701978 >> v1:172.21.15.105:6789/0 conn(0x7f78400701c0 legacy=0x7f78401424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 -- 172.21.15.57:0/1881701978 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784006e480 con 0x7f784013e330 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.787+0000 7f783ffff700 1 --2- 172.21.15.57:0/1881701978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784013e330 0x7f784013e7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f784006d860 tx=0x7f78380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4808215efbaa94b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f783e7fc700 1 -- 172.21.15.57:0/1881701978 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783800f6b0 con 0x7f784013e330 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f783e7fc700 1 -- 172.21.15.57:0/1881701978 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783800f810 con 0x7f784013e330 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f783e7fc700 1 -- 172.21.15.57:0/1881701978 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783800fbb0 con 0x7f784013e330 2023-10-06T03:53:22.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- 172.21.15.57:0/1881701978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784013e330 msgr2=0x7f784013e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 --2- 172.21.15.57:0/1881701978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784013e330 0x7f784013e7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f784006d860 tx=0x7f78380091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- 172.21.15.57:0/1881701978 shutdown_connections 2023-10-06T03:53:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 --2- 172.21.15.57:0/1881701978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784013e330 0x7f784013e7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 --2- 172.21.15.57:0/1881701978 >> v2:172.21.15.57:3300/0 conn(0x7f7840142bf0 0x7f784013ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- 172.21.15.57:0/1881701978 >> 172.21.15.57:0/1881701978 conn(0x7f78400b1a00 msgr2=0x7f78400b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- 172.21.15.57:0/1881701978 shutdown_connections 2023-10-06T03:53:22.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- 172.21.15.57:0/1881701978 wait complete. 2023-10-06T03:53:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 Processor -- start 2023-10-06T03:53:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.791+0000 7f7844b8a700 1 -- start start 2023-10-06T03:53:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 0x7f78401457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 0x7f7840146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840140770 con 0x7f784013e330 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78401529b0 con 0x7f7840142bf0 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78401410e0 con 0x7f78400701c0 2023-10-06T03:53:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 0x7f78401457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 0x7f78401457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48988/0 (socket says 172.21.15.57:48988) 2023-10-06T03:53:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783effd700 1 -- 172.21.15.57:0/2206843310 learned_addr learned my addr 172.21.15.57:0/2206843310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783f7fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 0x7f7840146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:22.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783f7fe700 1 -- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 msgr2=0x7f7840141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783f7fe700 1 -- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 msgr2=0x7f7840141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783f7fe700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783f7fe700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 -- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 msgr2=0x7f7840141b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 -- 172.21.15.57:0/2206843310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 msgr2=0x7f78401457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 0x7f78401457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 -- 172.21.15.57:0/2206843310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7838009420 con 0x7f7840142bf0 2023-10-06T03:53:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f783ffff700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 0x7f7840146350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7838018000 tx=0x7f7838019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838006af0 con 0x7f7840142bf0 2023-10-06T03:53:22.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783800fb90 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7840151ed0 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380106c0 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7840147390 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f783802d450 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.795+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f7838014070 con 0x7f7840142bf0 2023-10-06T03:53:22.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.799+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7840147580 con 0x7f7840142bf0 2023-10-06T03:53:22.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.803+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7838010d70 con 0x7f7840142bf0 2023-10-06T03:53:22.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.867+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784006d920 con 0x7f7840142bf0 2023-10-06T03:53:22.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f78377fe700 1 -- 172.21.15.57:0/2206843310 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f783802d700 con 0x7f7840142bf0 2023-10-06T03:53:22.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:22.875 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:22.614024+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 msgr2=0x7f7840146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 0x7f7840146350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7838018000 tx=0x7f7838019000 comp rx=0 tx=0).stop 2023-10-06T03:53:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 shutdown_connections 2023-10-06T03:53:22.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7840142bf0 0x7f7840146350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f784013e330 0x7f78401457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 --2- 172.21.15.57:0/2206843310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78400701c0 0x7f7840141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 >> 172.21.15.57:0/2206843310 conn(0x7f78400b1a00 msgr2=0x7f78400afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 shutdown_connections 2023-10-06T03:53:22.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:22.871+0000 7f7844b8a700 1 -- 172.21.15.57:0/2206843310 wait complete. 2023-10-06T03:53:22.888 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:53:22.888 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:53:22.918 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:22.908+0000 7f4029267000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:53:22.999 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:53:22.995+0000 7fcdb913f3c0 -1 Falling back to public interface 2023-10-06T03:53:23.018 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:53:23.015+0000 7f36544d03c0 -1 Falling back to public interface 2023-10-06T03:53:23.023 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:53:23.016+0000 7f3957e533c0 -1 Falling back to public interface 2023-10-06T03:53:23.024 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:53:23.016+0000 7fec019493c0 -1 Falling back to public interface 2023-10-06T03:53:23.024 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:53:23.016+0000 7f3956e1c700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2023-10-06T03:53:23.027 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:53:23.023+0000 7f1ee86943c0 -1 Falling back to public interface 2023-10-06T03:53:23.027 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:53:23.023+0000 7f9819d8b3c0 -1 Falling back to public interface 2023-10-06T03:53:23.049 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.043+0000 7f302fb2a000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:53:23.082 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.072+0000 7f4029267000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:53:23.147 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.140+0000 7f4029267000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:53:23.199 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.192+0000 7f4029267000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:53:23.224 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.219+0000 7f302fb2a000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:53:23.256 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.248+0000 7f4029267000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:53:23.292 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.287+0000 7f302fb2a000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:53:23.305 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:53:23.296+0000 7f9294f923c0 -1 Falling back to public interface 2023-10-06T03:53:23.315 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:53:23.308+0000 7fc9a55873c0 -1 Falling back to public interface 2023-10-06T03:53:23.348 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.343+0000 7f302fb2a000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:53:23.407 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.403+0000 7f302fb2a000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:53:23.541 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.532+0000 7f4029267000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:53:23.596 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.588+0000 7f4029267000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:53:23.661 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.652+0000 7f4029267000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:53:23.675 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.671+0000 7f302fb2a000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:53:23.694 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:23.734 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.731+0000 7f302fb2a000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:53:23.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 Processor -- start 2023-10-06T03:53:23.785 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 -- start start 2023-10-06T03:53:23.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd214142460 0x7fd2140b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:23.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214142f40 con 0x7fd2140b6190 2023-10-06T03:53:23.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21406ee80 con 0x7fd21413eea0 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd218eec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2141433d0 con 0x7fd214142460 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd20affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd214142460 0x7fd2140b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd20affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd214142460 0x7fd2140b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49004/0 (socket says 172.21.15.57:49004) 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd2137fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd2140b6190 0x7fd2140b01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:41516/0 (socket says 172.21.15.57:41516) 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.779+0000 7fd20affd700 1 -- 172.21.15.57:0/2588338365 learned_addr learned my addr 172.21.15.57:0/2588338365 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd20affd700 1 -- 172.21.15.57:0/2588338365 >> v1:172.21.15.105:6789/0 conn(0x7fd21413eea0 legacy=0x7fd21413f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd20affd700 1 -- 172.21.15.57:0/2588338365 >> v1:172.21.15.57:6789/0 conn(0x7fd2140b6190 legacy=0x7fd2140b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd20affd700 1 -- 172.21.15.57:0/2588338365 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2141428f0 con 0x7fd214142460 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd212ffd700 1 -- 172.21.15.57:0/2588338365 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717737100 0 0) 0x7fd214142f40 con 0x7fd2140b6190 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd20affd700 1 --2- 172.21.15.57:0/2588338365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd214142460 0x7fd2140b1cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099b0 tx=0x7fd1fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8db0e9947ce33cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:23.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd212ffd700 1 -- 172.21.15.57:0/2588338365 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00b860 con 0x7fd214142460 2023-10-06T03:53:23.788 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd212ffd700 1 -- 172.21.15.57:0/2588338365 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00b9c0 con 0x7fd214142460 2023-10-06T03:53:23.788 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd212ffd700 1 -- 172.21.15.57:0/2588338365 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00bd80 con 0x7fd214142460 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- 172.21.15.57:0/2588338365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd214142460 msgr2=0x7fd2140b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 --2- 172.21.15.57:0/2588338365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd214142460 0x7fd2140b1cd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099b0 tx=0x7fd1fc009250 comp rx=0 tx=0).stop 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- 172.21.15.57:0/2588338365 shutdown_connections 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 --2- 172.21.15.57:0/2588338365 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd214142460 0x7fd2140b1cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- 172.21.15.57:0/2588338365 >> 172.21.15.57:0/2588338365 conn(0x7fd214068c80 msgr2=0x7fd2140b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- 172.21.15.57:0/2588338365 shutdown_connections 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- 172.21.15.57:0/2588338365 wait complete. 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 Processor -- start 2023-10-06T03:53:23.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 -- start start 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.783+0000 7fd218eec700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2140b6190 0x7fd214153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd214142460 0x7fd214134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141535c0 con 0x7fd21413eea0 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21413bd50 con 0x7fd2140b6190 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21413c030 con 0x7fd214142460 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:23.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49008/0 (socket says 172.21.15.57:49008) 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 -- 172.21.15.57:0/1507444580 learned_addr learned my addr 172.21.15.57:0/1507444580 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd2137fe700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2140b6190 0x7fd214153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd213fff700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd214142460 0x7fd214134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 -- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd214142460 msgr2=0x7fd214134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd214142460 0x7fd214134970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 -- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2140b6190 msgr2=0x7fd214153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2140b6190 0x7fd214153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 -- 172.21.15.57:0/1507444580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0094f0 con 0x7fd21413eea0 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20affd700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0094c0 tx=0x7fd1fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc01f070 con 0x7fd21413eea0 2023-10-06T03:53:23.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc011e20 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc01a650 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21413ba30 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21413cb00 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd1fc01ad00 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd1fc023e10 con 0x7fd21413eea0 2023-10-06T03:53:23.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.787+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21406bee0 con 0x7fd21413eea0 2023-10-06T03:53:23.795 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.791+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd1fc028070 con 0x7fd21413eea0 2023-10-06T03:53:23.805 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.799+0000 7f302fb2a000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:53:23.819 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.812+0000 7f4029267000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:53:23.859 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.855+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd214142bd0 con 0x7fd21413eea0 2023-10-06T03:53:23.860 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.855+0000 7fd20bfff700 1 -- 172.21.15.57:0/1507444580 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd1fc015020 con 0x7fd21413eea0 2023-10-06T03:53:23.861 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:53:23.861 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:22.614024+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 msgr2=0x7fd21413a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0094c0 tx=0x7fd1fc017000 comp rx=0 tx=0).stop 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 shutdown_connections 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd214142460 0x7fd214134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd21413eea0 0x7fd21413a4a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.862 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 --2- 172.21.15.57:0/1507444580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2140b6190 0x7fd214153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:23.863 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 >> 172.21.15.57:0/1507444580 conn(0x7fd214068c80 msgr2=0x7fd21413fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:23.863 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 shutdown_connections 2023-10-06T03:53:23.863 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:23.859+0000 7fd218eec700 1 -- 172.21.15.57:0/1507444580 wait complete. 2023-10-06T03:53:23.871 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:53:23.885 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:23.876+0000 7f4029267000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:53:23.969 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:23.963+0000 7f302fb2a000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:53:24.037 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:24.035+0000 7f302fb2a000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:53:24.587 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:24.580+0000 7f4029267000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:53:24.771 INFO:tasks.ceph.mgr.y.smithi057.stderr:2023-10-06T03:53:24.767+0000 7f302fb2a000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:53:26.169 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:26.160+0000 7f4012363700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:53:26.612 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:53:26.604+0000 7fec019493c0 -1 osd.4 0 log_to_monitors true 2023-10-06T03:53:26.802 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:53:26.796+0000 7f3957e533c0 -1 osd.6 0 log_to_monitors true 2023-10-06T03:53:26.809 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:53:26.803+0000 7fcdb913f3c0 -1 osd.3 0 log_to_monitors true 2023-10-06T03:53:26.895 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:53:26.891+0000 7f36544d03c0 -1 osd.2 0 log_to_monitors true 2023-10-06T03:53:26.923 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:53:26.919+0000 7f9819d8b3c0 -1 osd.1 0 log_to_monitors true 2023-10-06T03:53:26.928 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:53:26.923+0000 7f1ee86943c0 -1 osd.0 0 log_to_monitors true 2023-10-06T03:53:27.051 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:53:27.044+0000 7f9294f923c0 -1 osd.7 0 log_to_monitors true 2023-10-06T03:53:27.166 INFO:tasks.ceph.mgr.x.smithi105.stderr:2023-10-06T03:53:27.156+0000 7f4012363700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:53:27.184 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:53:27.176+0000 7fc9a55873c0 -1 osd.5 0 log_to_monitors true 2023-10-06T03:53:30.099 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:53:30.092+0000 7f9290732700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:53:30.106 INFO:tasks.ceph.osd.7.smithi105.stderr:2023-10-06T03:53:30.096+0000 7f92894d6700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.124 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:53:30.119+0000 7f364fc70700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:53:30.132 INFO:tasks.ceph.osd.2.smithi057.stderr:2023-10-06T03:53:30.127+0000 7f3648a14700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.137 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:53:30.128+0000 7febfd0e9700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:53:30.143 INFO:tasks.ceph.osd.4.smithi105.stderr:2023-10-06T03:53:30.136+0000 7febf5e8d700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.170 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:53:30.167+0000 7f981552b700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:53:30.177 INFO:tasks.ceph.osd.1.smithi057.stderr:2023-10-06T03:53:30.171+0000 7f980e2cf700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.199 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:53:30.192+0000 7f39535f3700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:53:30.206 INFO:tasks.ceph.osd.6.smithi105.stderr:2023-10-06T03:53:30.200+0000 7f394c397700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.219 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:53:30.215+0000 7f1ee5659700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:53:30.222 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:53:30.219+0000 7fcdb6104700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:53:30.224 INFO:tasks.ceph.osd.0.smithi057.stderr:2023-10-06T03:53:30.219+0000 7f1edcbd8700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.228 INFO:tasks.ceph.osd.3.smithi057.stderr:2023-10-06T03:53:30.223+0000 7fcdad683700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.637 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:53:30.628+0000 7fc9a0d27700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:53:30.645 INFO:tasks.ceph.osd.5.smithi105.stderr:2023-10-06T03:53:30.636+0000 7fc999acb700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:53:30.679 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:30.781 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 Processor -- start 2023-10-06T03:53:30.782 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 -- start start 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50f006cd20 0x7f50f0141be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f50f006ecb0 0x7f50f0142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f00abe90 con 0x7f50f006c480 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f006dfe0 con 0x7f50f006ecb0 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f565d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f00ab840 con 0x7f50f006cd20 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f50f006ecb0 0x7f50f0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f50f006ecb0 0x7f50f0142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49058/0 (socket says 172.21.15.57:49058) 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 -- 172.21.15.57:0/4249245129 learned_addr learned my addr 172.21.15.57:0/4249245129 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:30.784 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50effff700 1 --2- 172.21.15.57:0/4249245129 >> v2:172.21.15.105:3300/0 conn(0x7f50f006cd20 0x7f50f0141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.785 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50ef7fe700 1 -- 172.21.15.57:0/4249245129 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145644280 0 0) 0x7f50f00abe90 con 0x7f50f006c480 2023-10-06T03:53:30.785 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 -- 172.21.15.57:0/4249245129 >> v2:172.21.15.105:3300/0 conn(0x7f50f006cd20 msgr2=0x7f50f0141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:30.785 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 --2- 172.21.15.57:0/4249245129 >> v2:172.21.15.105:3300/0 conn(0x7f50f006cd20 0x7f50f0141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 -- 172.21.15.57:0/4249245129 >> v1:172.21.15.57:6789/0 conn(0x7f50f006c480 legacy=0x7f50f00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 -- 172.21.15.57:0/4249245129 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00abb20 con 0x7f50f006ecb0 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50f4e5c700 1 --2- 172.21.15.57:0/4249245129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006ecb0 0x7f50f0142120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50f00b4f20 tx=0x7f50e800a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50adad4e31e45be6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50ef7fe700 1 -- 172.21.15.57:0/4249245129 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800f070 con 0x7f50f006ecb0 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50ef7fe700 1 -- 172.21.15.57:0/4249245129 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e800a2e0 con 0x7f50f006ecb0 2023-10-06T03:53:30.786 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.779+0000 7f50ef7fe700 1 -- 172.21.15.57:0/4249245129 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e800cd30 con 0x7f50f006ecb0 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- 172.21.15.57:0/4249245129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006ecb0 msgr2=0x7f50f0142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- 172.21.15.57:0/4249245129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006ecb0 0x7f50f0142120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50f00b4f20 tx=0x7f50e800a950 comp rx=0 tx=0).stop 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- 172.21.15.57:0/4249245129 shutdown_connections 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- 172.21.15.57:0/4249245129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006ecb0 0x7f50f0142120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- 172.21.15.57:0/4249245129 >> v2:172.21.15.105:3300/0 conn(0x7f50f006cd20 0x7f50f0141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- 172.21.15.57:0/4249245129 >> 172.21.15.57:0/4249245129 conn(0x7f50f00b4ff0 msgr2=0x7f50f00b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- 172.21.15.57:0/4249245129 shutdown_connections 2023-10-06T03:53:30.787 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- 172.21.15.57:0/4249245129 wait complete. 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 Processor -- start 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- start start 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50f006c480 0x7f50f013e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 0x7f50f00ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0134440 con 0x7f50f006cd20 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00af390 con 0x7f50f006ecb0 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f565d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f01341f0 con 0x7f50f006c480 2023-10-06T03:53:30.789 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:49060/0 (socket says 172.21.15.57:49060) 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 -- 172.21.15.57:0/1586728320 learned_addr learned my addr 172.21.15.57:0/1586728320 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50effff700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50f006c480 0x7f50f013e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f4e5c700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 0x7f50f00ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 -- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50f006c480 msgr2=0x7f50f013e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50f006c480 0x7f50f013e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 -- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 msgr2=0x7f50f00ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 0x7f50f00ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 -- 172.21.15.57:0/1586728320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e800abf0 con 0x7f50f006cd20 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50f4e5c700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 0x7f50f00ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50e77fe700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50d800c7e0 tx=0x7f50d8007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:30.790 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.783+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8011590 con 0x7f50f006cd20 2023-10-06T03:53:30.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8011710 con 0x7f50f006cd20 2023-10-06T03:53:30.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f00aef00 con 0x7f50f006cd20 2023-10-06T03:53:30.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8011ad0 con 0x7f50f006cd20 2023-10-06T03:53:30.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f013f020 con 0x7f50f006cd20 2023-10-06T03:53:30.791 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f00af090 con 0x7f50f006cd20 2023-10-06T03:53:30.792 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) v1 ==== 79903+0+0 (secure 0 0 0) 0x7f50d801c460 con 0x7f50f006cd20 2023-10-06T03:53:30.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.787+0000 7f50ecff9700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 0x7f50d0062970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:30.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.791+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f50d807b310 con 0x7f50f006cd20 2023-10-06T03:53:30.793 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.791+0000 7f50effff700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 0x7f50d0062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:30.794 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.791+0000 7f50effff700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 0x7f50d0062970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009d40 tx=0x7f50e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:30.799 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.795+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f50d804c770 con 0x7f50f006cd20 2023-10-06T03:53:30.959 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.955+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50f006d0f0 con 0x7f50f006cd20 2023-10-06T03:53:30.960 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.955+0000 7f50ecff9700 1 -- 172.21.15.57:0/1586728320 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f50d804fd90 con 0x7f50f006cd20 2023-10-06T03:53:30.960 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:53:30.960 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":13,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:29.187402+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:30.962 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 msgr2=0x7f50d0062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.962 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 0x7f50d0062970 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009d40 tx=0x7f50e0008040 comp rx=0 tx=0).stop 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 msgr2=0x7f50f0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f50d800c7e0 tx=0x7f50d8007dc0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 shutdown_connections 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f50d00604c0 0x7f50d0062970 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50f006ecb0 0x7f50f00ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.963 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f006cd20 0x7f50f0154b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.964 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 --2- 172.21.15.57:0/1586728320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50f006c480 0x7f50f013e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:30.964 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 >> 172.21.15.57:0/1586728320 conn(0x7f50f00b4ff0 msgr2=0x7f50f00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:30.964 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 shutdown_connections 2023-10-06T03:53:30.964 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:30.959+0000 7f50f565d700 1 -- 172.21.15.57:0/1586728320 wait complete. 2023-10-06T03:53:30.972 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:53:32.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:53:32.763 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:53:37.778 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:37.881 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 Processor -- start 2023-10-06T03:53:37.882 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- start start 2023-10-06T03:53:37.882 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c940ab8c0 0x7f0c940ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.882 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 0x7f0c940ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.882 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c94140c90 con 0x7f0c940b1ae0 2023-10-06T03:53:37.882 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c94140f70 con 0x7f0c940ab8c0 2023-10-06T03:53:37.883 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c94143700 con 0x7f0c94144330 2023-10-06T03:53:37.883 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0c940ab8c0 0x7f0c940ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.883 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9924d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0c940b1ae0 0x7f0c94143c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57898/0 (socket says 172.21.15.57:57898) 2023-10-06T03:53:37.883 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9924d700 1 -- 172.21.15.57:0/3608811909 learned_addr learned my addr 172.21.15.57:0/3608811909 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 -- 172.21.15.57:0/3608811909 >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 msgr2=0x7f0c940ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c99a4e700 1 --2- 172.21.15.57:0/3608811909 >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 0x7f0c940ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c8bfff700 1 -- 172.21.15.57:0/3608811909 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795259950 0 0) 0x7f0c94140c90 con 0x7f0c940b1ae0 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 --2- 172.21.15.57:0/3608811909 >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 0x7f0c940ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 -- 172.21.15.57:0/3608811909 >> v1:172.21.15.57:6789/0 conn(0x7f0c940b1ae0 legacy=0x7f0c94143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:37.885 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 -- 172.21.15.57:0/3608811909 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c940b10f0 con 0x7f0c940ab8c0 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c99a4e700 1 --2- 172.21.15.57:0/3608811909 >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 0x7f0c940ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c98a4c700 1 --2- 172.21.15.57:0/3608811909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c940ab8c0 0x7f0c940ae140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c94140160 tx=0x7f0c840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95541a9433ec1125 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c8bfff700 1 -- 172.21.15.57:0/3608811909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400b6b0 con 0x7f0c940ab8c0 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c8bfff700 1 -- 172.21.15.57:0/3608811909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8400b810 con 0x7f0c940ab8c0 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c8bfff700 1 -- 172.21.15.57:0/3608811909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400bbb0 con 0x7f0c940ab8c0 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/3608811909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c940ab8c0 msgr2=0x7f0c940ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/3608811909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c940ab8c0 0x7f0c940ae140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0c94140160 tx=0x7f0c840091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/3608811909 shutdown_connections 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/3608811909 >> v2:172.21.15.105:3300/0 conn(0x7f0c94144330 0x7f0c940ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/3608811909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c940ab8c0 0x7f0c940ae140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.886 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/3608811909 >> 172.21.15.57:0/3608811909 conn(0x7f0c94067b40 msgr2=0x7f0c940b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:37.887 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/3608811909 shutdown_connections 2023-10-06T03:53:37.887 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.879+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/3608811909 wait complete. 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 Processor -- start 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- start start 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c940ab8c0 0x7f0c9413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940b1ae0 0x7f0c9413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c940a4b30 con 0x7f0c94144330 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941509b0 con 0x7f0c940b1ae0 2023-10-06T03:53:37.889 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94150e40 con 0x7f0c940ab8c0 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43940/0 (socket says 172.21.15.57:43940) 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 -- 172.21.15.57:0/2044362940 learned_addr learned my addr 172.21.15.57:0/2044362940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c98a4c700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940b1ae0 0x7f0c9413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9924d700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c940ab8c0 0x7f0c9413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 -- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c940ab8c0 msgr2=0x7f0c9413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c940ab8c0 0x7f0c9413c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 -- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940b1ae0 msgr2=0x7f0c9413cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940b1ae0 0x7f0c9413cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:37.890 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 -- 172.21.15.57:0/2044362940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c84009420 con 0x7f0c94144330 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c99a4e700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00cfc0 tx=0x7f0c8c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c015440 con 0x7f0c94144330 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c8c0155a0 con 0x7f0c94144330 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c94150360 con 0x7f0c94144330 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c015960 con 0x7f0c94144330 2023-10-06T03:53:37.891 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.883+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c94138ba0 con 0x7f0c94144330 2023-10-06T03:53:37.892 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c94150b20 con 0x7f0c94144330 2023-10-06T03:53:37.892 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0c8c00d440 con 0x7f0c94144330 2023-10-06T03:53:37.892 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c897fa700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 0x7f0c78062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:37.892 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0c8c07d0d0 con 0x7f0c94144330 2023-10-06T03:53:37.892 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c9924d700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 0x7f0c78062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:37.893 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.887+0000 7f0c9924d700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 0x7f0c78062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c900011e0 tx=0x7f0c90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:37.900 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:37.895+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c8c04da10 con 0x7f0c94144330 2023-10-06T03:53:38.060 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.055+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c9404be00 con 0x7f0c94144330 2023-10-06T03:53:38.061 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.055+0000 7f0c897fa700 1 -- 172.21.15.57:0/2044362940 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f0c8c051030 con 0x7f0c94144330 2023-10-06T03:53:38.061 INFO:teuthology.misc.health.smithi057.stdout: 2023-10-06T03:53:38.062 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":18,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:35.328395+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 msgr2=0x7f0c78062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 0x7f0c78062a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c900011e0 tx=0x7f0c90009040 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 msgr2=0x7f0c94153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00cfc0 tx=0x7f0c8c0078d0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 shutdown_connections 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0c78060550 0x7f0c78062a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0c94144330 0x7f0c94153540 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940b1ae0 0x7f0c9413cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 --2- 172.21.15.57:0/2044362940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c940ab8c0 0x7f0c9413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.064 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 >> 172.21.15.57:0/2044362940 conn(0x7f0c94067b40 msgr2=0x7f0c940b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:38.065 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 shutdown_connections 2023-10-06T03:53:38.065 INFO:teuthology.misc.health.smithi057.stderr:2023-10-06T03:53:38.059+0000 7f0c9b4b1700 1 -- 172.21.15.57:0/2044362940 wait complete. 2023-10-06T03:53:38.074 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:53:38.074 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:53:38.074 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:53:38.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 Processor -- start 2023-10-06T03:53:38.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 -- start start 2023-10-06T03:53:38.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 0x7f9a040b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406cc60 0x7f9a040b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.186 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a0406f300 0x7f9a041424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0406ddb0 con 0x7f9a0406f300 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0413fea0 con 0x7f9a0406d670 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.179+0000 7f9a03fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0413f850 con 0x7f9a0406cc60 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a0406f300 0x7f9a041424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a0406f300 0x7f9a041424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43944/0 (socket says 172.21.15.57:43944) 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 -- 172.21.15.57:0/1586372013 learned_addr learned my addr 172.21.15.57:0/1586372013 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a027fc700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406cc60 0x7f9a040b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a02ffd700 1 --2- 172.21.15.57:0/1586372013 >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 0x7f9a040b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 -- 172.21.15.57:0/1586372013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406cc60 msgr2=0x7f9a040b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406cc60 0x7f9a040b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.187 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 -- 172.21.15.57:0/1586372013 >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 msgr2=0x7f9a040b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 --2- 172.21.15.57:0/1586372013 >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 0x7f9a040b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 -- 172.21.15.57:0/1586372013 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0413fb30 con 0x7f9a0406f300 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a02ffd700 1 --2- 172.21.15.57:0/1586372013 >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 0x7f9a040b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a037fe700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406f300 0x7f9a041424e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a04068da0 tx=0x7f99fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa665bbac28ac67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a01ffb700 1 -- 172.21.15.57:0/1586372013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00e070 con 0x7f9a0406f300 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a01ffb700 1 -- 172.21.15.57:0/1586372013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc00ba50 con 0x7f9a0406f300 2023-10-06T03:53:38.188 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a01ffb700 1 -- 172.21.15.57:0/1586372013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0092e0 con 0x7f9a0406f300 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 -- 172.21.15.57:0/1586372013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406f300 msgr2=0x7f9a041424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406f300 0x7f9a041424e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a04068da0 tx=0x7f99fc009840 comp rx=0 tx=0).stop 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 -- 172.21.15.57:0/1586372013 shutdown_connections 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406f300 0x7f9a041424e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 --2- 172.21.15.57:0/1586372013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406cc60 0x7f9a040b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 --2- 172.21.15.57:0/1586372013 >> v2:172.21.15.105:3300/0 conn(0x7f9a0406d670 0x7f9a040b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 -- 172.21.15.57:0/1586372013 >> 172.21.15.57:0/1586372013 conn(0x7f9a04068180 msgr2=0x7f9a04068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:38.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 -- 172.21.15.57:0/1586372013 shutdown_connections 2023-10-06T03:53:38.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.183+0000 7f9a03fff700 1 -- 172.21.15.57:0/1586372013 wait complete. 2023-10-06T03:53:38.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 Processor -- start 2023-10-06T03:53:38.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- start start 2023-10-06T03:53:38.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406d670 0x7f9a040abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a0406f300 0x7f9a04137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0413b7d0 con 0x7f9a0406cc60 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0412fbe0 con 0x7f9a0406f300 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040acd90 con 0x7f9a0406d670 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43948/0 (socket says 172.21.15.57:43948) 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 -- 172.21.15.57:0/962062417 learned_addr learned my addr 172.21.15.57:0/962062417 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a027fc700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406d670 0x7f9a040abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a037fe700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a0406f300 0x7f9a04137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 -- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406d670 msgr2=0x7f9a040abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406d670 0x7f9a040abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 -- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a0406f300 msgr2=0x7f9a04137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a0406f300 0x7f9a04137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 -- 172.21.15.57:0/962062417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc009ae0 con 0x7f9a0406cc60 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a02ffd700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f99f400e8d0 tx=0x7f99f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4013410 con 0x7f9a0406cc60 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f4013570 con 0x7f9a0406cc60 2023-10-06T03:53:38.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4013910 con 0x7f9a0406cc60 2023-10-06T03:53:38.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a040aee80 con 0x7f9a0406cc60 2023-10-06T03:53:38.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.187+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0413cb40 con 0x7f9a0406cc60 2023-10-06T03:53:38.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.191+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0406c460 con 0x7f9a0406cc60 2023-10-06T03:53:38.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.191+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f99f4013d40 con 0x7f9a0406cc60 2023-10-06T03:53:38.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.191+0000 7f99eaffd700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 0x7f99f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.191+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f99f407c110 con 0x7f9a0406cc60 2023-10-06T03:53:38.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.191+0000 7f9a027fc700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 0x7f99f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.195+0000 7f9a027fc700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 0x7f99f0062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a040b24a0 tx=0x7f99f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.199+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99f404ca50 con 0x7f9a0406cc60 2023-10-06T03:53:38.368 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.363+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9a0404b5c0 con 0x7f9a0406cc60 2023-10-06T03:53:38.467 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.463+0000 7f99eaffd700 1 -- 172.21.15.57:0/962062417 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f99f4050070 con 0x7f9a0406cc60 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 msgr2=0x7f99f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 0x7f99f0062a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a040b24a0 tx=0x7f99f8008040 comp rx=0 tx=0).stop 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 msgr2=0x7f9a0412f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f99f400e8d0 tx=0x7f99f4008040 comp rx=0 tx=0).stop 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 shutdown_connections 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f0060550 0x7f99f0062a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a0406f300 0x7f9a04137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a0406d670 0x7f9a040abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 --2- 172.21.15.57:0/962062417 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0406cc60 0x7f9a0412f0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 >> 172.21.15.57:0/962062417 conn(0x7f9a04068180 msgr2=0x7f9a040b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:38.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 shutdown_connections 2023-10-06T03:53:38.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.467+0000 7f9a03fff700 1 -- 172.21.15.57:0/962062417 wait complete. 2023-10-06T03:53:38.473 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2023-10-06T03:53:38.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:53:38.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 Processor -- start 2023-10-06T03:53:38.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 -- start start 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b0406dd20 0x7f4b0406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4b04068470 0x7f4b04146230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b040688b0 con 0x7f4b040b5a60 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0406e130 con 0x7f4b0406dd20 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b0359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b041457e0 con 0x7f4b04068470 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4af9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b0406dd20 0x7f4b0406cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4af9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b0406dd20 0x7f4b0406cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43952/0 (socket says 172.21.15.57:43952) 2023-10-06T03:53:38.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4af9d9b700 1 -- 172.21.15.57:0/371513681 learned_addr learned my addr 172.21.15.57:0/371513681 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:38.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.591+0000 7f4b02d9d700 1 --2- 172.21.15.57:0/371513681 >> v2:172.21.15.105:3300/0 conn(0x7f4b04068470 0x7f4b04146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4af9d9b700 1 -- 172.21.15.57:0/371513681 >> v2:172.21.15.105:3300/0 conn(0x7f4b04068470 msgr2=0x7f4b04146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4af9d9b700 1 --2- 172.21.15.57:0/371513681 >> v2:172.21.15.105:3300/0 conn(0x7f4b04068470 0x7f4b04146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4af9d9b700 1 -- 172.21.15.57:0/371513681 >> v1:172.21.15.105:6789/0 conn(0x7f4b040b5a60 legacy=0x7f4b0406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4af9d9b700 1 -- 172.21.15.57:0/371513681 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04145da0 con 0x7f4b0406dd20 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4af9d9b700 1 --2- 172.21.15.57:0/371513681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0406dd20 0x7f4b0406cd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b040b3750 tx=0x7f4af4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe456cdd86caa77b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b01d9b700 1 -- 172.21.15.57:0/371513681 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4009e70 con 0x7f4b0406dd20 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b01d9b700 1 -- 172.21.15.57:0/371513681 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400b860 con 0x7f4b0406dd20 2023-10-06T03:53:38.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b01d9b700 1 -- 172.21.15.57:0/371513681 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400bc00 con 0x7f4b0406dd20 2023-10-06T03:53:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 -- 172.21.15.57:0/371513681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0406dd20 msgr2=0x7f4b0406cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 --2- 172.21.15.57:0/371513681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0406dd20 0x7f4b0406cd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b040b3750 tx=0x7f4af4009250 comp rx=0 tx=0).stop 2023-10-06T03:53:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 -- 172.21.15.57:0/371513681 shutdown_connections 2023-10-06T03:53:38.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 --2- 172.21.15.57:0/371513681 >> v2:172.21.15.105:3300/0 conn(0x7f4b04068470 0x7f4b04146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 --2- 172.21.15.57:0/371513681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b0406dd20 0x7f4b0406cd60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 -- 172.21.15.57:0/371513681 >> 172.21.15.57:0/371513681 conn(0x7f4b040b2370 msgr2=0x7f4b040b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:38.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 -- 172.21.15.57:0/371513681 shutdown_connections 2023-10-06T03:53:38.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.595+0000 7f4b0359e700 1 -- 172.21.15.57:0/371513681 wait complete. 2023-10-06T03:53:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 Processor -- start 2023-10-06T03:53:38.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 -- start start 2023-10-06T03:53:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 0x7f4b0413cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 0x7f4b0413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04152b70 con 0x7f4b04068470 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04152e50 con 0x7f4b040b5a60 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04141ed0 con 0x7f4b0406dd20 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4af9d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 0x7f4b0413cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43960/0 (socket says 172.21.15.57:43960) 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 -- 172.21.15.57:0/314931140 learned_addr learned my addr 172.21.15.57:0/314931140 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:38.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b02d9d700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 0x7f4b0413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 -- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 msgr2=0x7f4b0413cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 0x7f4b0413cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 -- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 msgr2=0x7f4b0413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 0x7f4b0413d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b0259c700 1 -- 172.21.15.57:0/314931140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40094f0 con 0x7f4b04068470 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4af9d9b700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 0x7f4b0413cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.599+0000 7f4b02d9d700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 0x7f4b0413d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4b0259c700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c590 tx=0x7f4aec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011590 con 0x7f4b04068470 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec011710 con 0x7f4b04068470 2023-10-06T03:53:38.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b04142710 con 0x7f4b04068470 2023-10-06T03:53:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011ad0 con 0x7f4b04068470 2023-10-06T03:53:38.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b040b0060 con 0x7f4b04068470 2023-10-06T03:53:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4aec01b3b0 con 0x7f4b04068470 2023-10-06T03:53:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.603+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0413cbc0 con 0x7f4b04068470 2023-10-06T03:53:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.607+0000 7f4afaffd700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 0x7f4ae8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:38.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.607+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f4aec07ba00 con 0x7f4b04068470 2023-10-06T03:53:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.607+0000 7f4af9d9b700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 0x7f4ae8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:38.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.607+0000 7f4af9d9b700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 0x7f4ae8062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b040b3750 tx=0x7f4af4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:38.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.611+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4aec04c150 con 0x7f4b04068470 2023-10-06T03:53:38.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:38.775+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b04152cb0 con 0x7f4b04068470 2023-10-06T03:53:39.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.483+0000 7f4afaffd700 1 -- 172.21.15.57:0/314931140 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4b04152cb0 con 0x7f4b04068470 2023-10-06T03:53:39.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 msgr2=0x7f4ae8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.493 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 0x7f4ae8062a30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b040b3750 tx=0x7f4af4017000 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 msgr2=0x7f4b04141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00c590 tx=0x7f4aec00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 shutdown_connections 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4ae8060580 0x7f4ae8062a30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040b5a60 0x7f4b0413d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406dd20 0x7f4b0413cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 --2- 172.21.15.57:0/314931140 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b04068470 0x7f4b04141990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.487+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 >> 172.21.15.57:0/314931140 conn(0x7f4b040b2370 msgr2=0x7f4b0413bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.491+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 shutdown_connections 2023-10-06T03:53:39.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.491+0000 7f4b0359e700 1 -- 172.21.15.57:0/314931140 wait complete. 2023-10-06T03:53:39.495 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:53:39.509 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:53:39.509 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:53:39.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:53:39.511 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:53:39.511 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:53:39.511 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:53:39.513 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:53:39.514 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:53:39.514 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:39.583 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2023-10-06T03:53:39.587 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:53:39.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 Processor -- start 2023-10-06T03:53:39.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 -- start start 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a8c143730 0x7f6a8c143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a8c0b0240 0x7f6a8c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0b1c20 con 0x7f6a8c06bfc0 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c1440f0 con 0x7f6a8c143730 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a92f05700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0aeae0 con 0x7f6a8c0b0240 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a8c143730 0x7f6a8c143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a8c143730 0x7f6a8c143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43978/0 (socket says 172.21.15.57:43978) 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 -- 172.21.15.57:0/1170634460 learned_addr learned my addr 172.21.15.57:0/1170634460 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:39.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a914a2700 1 --2- 172.21.15.57:0/1170634460 >> v2:172.21.15.105:3300/0 conn(0x7f6a8c0b0240 0x7f6a8c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 -- 172.21.15.57:0/1170634460 >> v2:172.21.15.105:3300/0 conn(0x7f6a8c0b0240 msgr2=0x7f6a8c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:39.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 --2- 172.21.15.57:0/1170634460 >> v2:172.21.15.105:3300/0 conn(0x7f6a8c0b0240 0x7f6a8c0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 -- 172.21.15.57:0/1170634460 >> v1:172.21.15.105:6789/0 conn(0x7f6a8c06bfc0 legacy=0x7f6a8c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 -- 172.21.15.57:0/1170634460 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c06cbc0 con 0x7f6a8c143730 2023-10-06T03:53:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8bfff700 1 --2- 172.21.15.57:0/1170634460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c143bb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06cb30 tx=0x7f6a80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d4403ba03ab672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8b7fe700 1 -- 172.21.15.57:0/1170634460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80009e70 con 0x7f6a8c143730 2023-10-06T03:53:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8b7fe700 1 -- 172.21.15.57:0/1170634460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000b860 con 0x7f6a8c143730 2023-10-06T03:53:39.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.607+0000 7f6a8b7fe700 1 -- 172.21.15.57:0/1170634460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000bc00 con 0x7f6a8c143730 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1170634460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 msgr2=0x7f6a8c143bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1170634460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c143bb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c06cb30 tx=0x7f6a80009250 comp rx=0 tx=0).stop 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1170634460 shutdown_connections 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1170634460 >> v2:172.21.15.105:3300/0 conn(0x7f6a8c0b0240 0x7f6a8c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1170634460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c143bb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1170634460 >> 172.21.15.57:0/1170634460 conn(0x7f6a8c067070 msgr2=0x7f6a8c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1170634460 shutdown_connections 2023-10-06T03:53:39.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1170634460 wait complete. 2023-10-06T03:53:39.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 Processor -- start 2023-10-06T03:53:39.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- start start 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a8c06bfc0 0x7f6a8c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a8c0b0240 0x7f6a8c13b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ac7e0 con 0x7f6a8c143730 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0ac170 con 0x7f6a8c0b0240 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c155ef0 con 0x7f6a8c06bfc0 2023-10-06T03:53:39.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43980/0 (socket says 172.21.15.57:43980) 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 -- 172.21.15.57:0/1309643609 learned_addr learned my addr 172.21.15.57:0/1309643609 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a8bfff700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a8c0b0240 0x7f6a8c13b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a90ca1700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a8c06bfc0 0x7f6a8c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 -- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a8c06bfc0 msgr2=0x7f6a8c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a8c06bfc0 0x7f6a8c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 -- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a8c0b0240 msgr2=0x7f6a8c13b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a8c0b0240 0x7f6a8c13b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 -- 172.21.15.57:0/1309643609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800094f0 con 0x7f6a8c143730 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a914a2700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009ec0 tx=0x7f6a8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400cb10 con 0x7f6a8c143730 2023-10-06T03:53:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8400f040 con 0x7f6a8c143730 2023-10-06T03:53:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400cec0 con 0x7f6a8c143730 2023-10-06T03:53:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.611+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0b7110 con 0x7f6a8c143730 2023-10-06T03:53:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c13cc30 con 0x7f6a8c143730 2023-10-06T03:53:39.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c04be00 con 0x7f6a8c143730 2023-10-06T03:53:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6a84014690 con 0x7f6a8c143730 2023-10-06T03:53:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a88ff9700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 0x7f6a78062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6a8407cdf0 con 0x7f6a8c143730 2023-10-06T03:53:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a90ca1700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 0x7f6a78062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.615+0000 7f6a90ca1700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 0x7f6a78062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0039f0 tx=0x7f6a7c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.619+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6a8404d5d0 con 0x7f6a8c143730 2023-10-06T03:53:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.779+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a8c0ae800 con 0x7f6a8c143730 2023-10-06T03:53:39.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.779+0000 7f6a88ff9700 1 -- 172.21.15.57:0/1309643609 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f6a84018090 con 0x7f6a8c143730 2023-10-06T03:53:39.784 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:39.784 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:39.462863+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 msgr2=0x7f6a78062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 0x7f6a78062a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0039f0 tx=0x7f6a7c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 msgr2=0x7f6a8c13b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009ec0 tx=0x7f6a8400b040 comp rx=0 tx=0).stop 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 shutdown_connections 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a78060580 0x7f6a78062a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a8c143730 0x7f6a8c13b9e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a8c0b0240 0x7f6a8c13b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 --2- 172.21.15.57:0/1309643609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a8c06bfc0 0x7f6a8c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 >> 172.21.15.57:0/1309643609 conn(0x7f6a8c067070 msgr2=0x7f6a8c140180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:39.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 shutdown_connections 2023-10-06T03:53:39.788 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.783+0000 7f6a92f05700 1 -- 172.21.15.57:0/1309643609 wait complete. 2023-10-06T03:53:39.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:53:32.687516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:53:38.405877+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:53:39.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:53:39.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 Processor -- start 2023-10-06T03:53:39.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 -- start start 2023-10-06T03:53:39.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f817c067300 0x7f817c0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0b10c0 con 0x7f817c1456d0 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0676d0 con 0x7f817c0affc0 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f8180ab6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0b52b0 con 0x7f817c067300 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f817b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f817c067300 0x7f817c0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f817bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f817c1456d0 0x7f817c145b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57920/0 (socket says 172.21.15.57:57920) 2023-10-06T03:53:39.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.911+0000 7f817bfff700 1 -- 172.21.15.57:0/2492740665 learned_addr learned my addr 172.21.15.57:0/2492740665 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817b7fe700 1 -- 172.21.15.57:0/2492740665 >> v1:172.21.15.105:6789/0 conn(0x7f817c0affc0 legacy=0x7f817c0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817b7fe700 1 -- 172.21.15.57:0/2492740665 >> v1:172.21.15.57:6789/0 conn(0x7f817c1456d0 legacy=0x7f817c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817a7fc700 1 -- 172.21.15.57:0/2492740665 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796074679 0 0) 0x7f817c0b10c0 con 0x7f817c1456d0 2023-10-06T03:53:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817b7fe700 1 -- 172.21.15.57:0/2492740665 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0b07d0 con 0x7f817c067300 2023-10-06T03:53:39.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817b7fe700 1 --2- 172.21.15.57:0/2492740665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0b2c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81700098e0 tx=0x7f81700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267554c8a84dc634 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817a7fc700 1 -- 172.21.15.57:0/2492740665 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170009e80 con 0x7f817c067300 2023-10-06T03:53:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817a7fc700 1 -- 172.21.15.57:0/2492740665 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000b860 con 0x7f817c067300 2023-10-06T03:53:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f817a7fc700 1 -- 172.21.15.57:0/2492740665 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000bbe0 con 0x7f817c067300 2023-10-06T03:53:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 -- 172.21.15.57:0/2492740665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 msgr2=0x7f817c0b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2492740665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0b2c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81700098e0 tx=0x7f81700091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 -- 172.21.15.57:0/2492740665 shutdown_connections 2023-10-06T03:53:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2492740665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0b2c00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 -- 172.21.15.57:0/2492740665 >> 172.21.15.57:0/2492740665 conn(0x7f817c06f140 msgr2=0x7f817c0b8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 -- 172.21.15.57:0/2492740665 shutdown_connections 2023-10-06T03:53:39.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.915+0000 7f8180ab6700 1 -- 172.21.15.57:0/2492740665 wait complete. 2023-10-06T03:53:39.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 Processor -- start 2023-10-06T03:53:39.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- start start 2023-10-06T03:53:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 0x7f817c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 0x7f817c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0aba40 con 0x7f817c067300 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0af6a0 con 0x7f817c1456d0 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c155e80 con 0x7f817c0affc0 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43996/0 (socket says 172.21.15.57:43996) 2023-10-06T03:53:39.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 -- 172.21.15.57:0/2226401816 learned_addr learned my addr 172.21.15.57:0/2226401816 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817affd700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 0x7f817c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817bfff700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 0x7f817c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 -- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 msgr2=0x7f817c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 0x7f817c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 -- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 msgr2=0x7f817c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 0x7f817c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:39.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 -- 172.21.15.57:0/2226401816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170009420 con 0x7f817c067300 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817affd700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 0x7f817c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817bfff700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 0x7f817c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f817b7fe700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f817c06f7f0 tx=0x7f8170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817001f070 con 0x7f817c067300 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170011420 con 0x7f817c067300 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0ae950 con 0x7f817c067300 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000bbe0 con 0x7f817c067300 2023-10-06T03:53:39.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.919+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c155b10 con 0x7f817c067300 2023-10-06T03:53:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f81700119d0 con 0x7f817c067300 2023-10-06T03:53:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f81637fe700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 0x7f8168062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:39.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f817007da70 con 0x7f817c067300 2023-10-06T03:53:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c06f540 con 0x7f817c067300 2023-10-06T03:53:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f817affd700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 0x7f8168062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:39.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.923+0000 7f817affd700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 0x7f8168062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f816c007fd0 tx=0x7f816c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:39.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:39.931+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f817004e250 con 0x7f817c067300 2023-10-06T03:53:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.091+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f817c04b5c0 con 0x7f817c067300 2023-10-06T03:53:40.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f81637fe700 1 -- 172.21.15.57:0/2226401816 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8170015070 con 0x7f817c067300 2023-10-06T03:53:40.098 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:53:40.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 msgr2=0x7f8168062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 0x7f8168062a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f816c007fd0 tx=0x7f816c009040 comp rx=0 tx=0).stop 2023-10-06T03:53:40.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 msgr2=0x7f817c0ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f817c06f7f0 tx=0x7f8170017000 comp rx=0 tx=0).stop 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 shutdown_connections 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8168060580 0x7f8168062a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f817c1456d0 0x7f817c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f817c0affc0 0x7f817c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 --2- 172.21.15.57:0/2226401816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f817c067300 0x7f817c0ae410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 >> 172.21.15.57:0/2226401816 conn(0x7f817c06f140 msgr2=0x7f817c0b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 shutdown_connections 2023-10-06T03:53:40.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.095+0000 7f8180ab6700 1 -- 172.21.15.57:0/2226401816 wait complete. 2023-10-06T03:53:40.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:53:40.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 Processor -- start 2023-10-06T03:53:40.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 -- start start 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd6980701c0 0x7fd69813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6980aeb30 0x7fd6981497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6980af210 con 0x7fd69806d4c0 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69806ecd0 con 0x7fd6980701c0 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69e7da700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69806cfe0 con 0x7fd6980aeb30 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd6980701c0 0x7fd69813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd6980701c0 0x7fd69813ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44006/0 (socket says 172.21.15.57:44006) 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 -- 172.21.15.57:0/79036534 learned_addr learned my addr 172.21.15.57:0/79036534 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69dfd9700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6980aeb30 0x7fd6981497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 -- 172.21.15.57:0/79036534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6980aeb30 msgr2=0x7fd6981497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:40.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6980aeb30 0x7fd6981497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 -- 172.21.15.57:0/79036534 >> v1:172.21.15.105:6789/0 conn(0x7fd69806d4c0 legacy=0x7fd6980ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 -- 172.21.15.57:0/79036534 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69806e560 con 0x7fd6980701c0 2023-10-06T03:53:40.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.227+0000 7fd69d7d8700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980701c0 0x7fd69813ee90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd69400bc30 tx=0x7fd69400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622f1d0e7d7e7ea6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd68ffff700 1 -- 172.21.15.57:0/79036534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694005c10 con 0x7fd6980701c0 2023-10-06T03:53:40.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd68ffff700 1 -- 172.21.15.57:0/79036534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694005d70 con 0x7fd6980701c0 2023-10-06T03:53:40.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd68ffff700 1 -- 172.21.15.57:0/79036534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400dbc0 con 0x7fd6980701c0 2023-10-06T03:53:40.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- 172.21.15.57:0/79036534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980701c0 msgr2=0x7fd69813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980701c0 0x7fd69813ee90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd69400bc30 tx=0x7fd69400b4c0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- 172.21.15.57:0/79036534 shutdown_connections 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6980aeb30 0x7fd6981497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- 172.21.15.57:0/79036534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980701c0 0x7fd69813ee90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- 172.21.15.57:0/79036534 >> 172.21.15.57:0/79036534 conn(0x7fd6980b1a90 msgr2=0x7fd6980b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- 172.21.15.57:0/79036534 shutdown_connections 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- 172.21.15.57:0/79036534 wait complete. 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 Processor -- start 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- start start 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69806d4c0 0x7fd6980ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6980701c0 0x7fd6980a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980a82c0 con 0x7fd6980aeb30 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980a84c0 con 0x7fd6980701c0 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69e7da700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6980a6b50 con 0x7fd69806d4c0 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44018/0 (socket says 172.21.15.57:44018) 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 -- 172.21.15.57:0/4209544880 learned_addr learned my addr 172.21.15.57:0/4209544880 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69cfd7700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6980701c0 0x7fd6980a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69d7d8700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69806d4c0 0x7fd6980ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 -- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69806d4c0 msgr2=0x7fd6980ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69806d4c0 0x7fd6980ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 -- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6980701c0 msgr2=0x7fd6980a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.240 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6980701c0 0x7fd6980a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.231+0000 7fd69dfd9700 1 -- 172.21.15.57:0/4209544880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69400b720 con 0x7fd6980aeb30 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd69dfd9700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd690009df0 tx=0x7fd69000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000caa0 con 0x7fd6980aeb30 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6980a6df0 con 0x7fd6980aeb30 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000f040 con 0x7fd6980aeb30 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6980a6570 con 0x7fd6980aeb30 2023-10-06T03:53:40.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000ce50 con 0x7fd6980aeb30 2023-10-06T03:53:40.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd690014690 con 0x7fd6980aeb30 2023-10-06T03:53:40.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.235+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69806b9a0 con 0x7fd6980aeb30 2023-10-06T03:53:40.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.239+0000 7fd68d7fa700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 0x7fd67c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.239+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd69007d030 con 0x7fd6980aeb30 2023-10-06T03:53:40.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.239+0000 7fd69d7d8700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 0x7fd67c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.239+0000 7fd69d7d8700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 0x7fd67c062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b500 tx=0x7fd69401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.247+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd69004d810 con 0x7fd6980aeb30 2023-10-06T03:53:40.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.407+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd69806e840 con 0x7fd6980aeb30 2023-10-06T03:53:40.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.407+0000 7fd68d7fa700 1 -- 172.21.15.57:0/4209544880 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd690050e30 con 0x7fd6980aeb30 2023-10-06T03:53:40.413 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:53:40.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 msgr2=0x7fd67c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 0x7fd67c062a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b500 tx=0x7fd69401a000 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 msgr2=0x7fd6980a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd690009df0 tx=0x7fd69000b040 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 shutdown_connections 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd67c060580 0x7fd67c062a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6980aeb30 0x7fd6980a4a60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6980701c0 0x7fd6980a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 --2- 172.21.15.57:0/4209544880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd69806d4c0 0x7fd6980ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 >> 172.21.15.57:0/4209544880 conn(0x7fd6980b1a90 msgr2=0x7fd698069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 shutdown_connections 2023-10-06T03:53:40.416 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.411+0000 7fd69e7da700 1 -- 172.21.15.57:0/4209544880 wait complete. 2023-10-06T03:53:40.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:53:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 Processor -- start 2023-10-06T03:53:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 -- start start 2023-10-06T03:53:40.535 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc80b7040 0x7fdbc8068fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdbc80b7410 0x7fdbc8142880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdbc8142dc0 0x7fdbc8145b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc8142170 con 0x7fdbc8142dc0 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc8069a90 con 0x7fdbc80b7410 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbce78c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81423f0 con 0x7fdbc80b7040 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdbc8142dc0 0x7fdbc8145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdbc8142dc0 0x7fdbc8145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44024/0 (socket says 172.21.15.57:44024) 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 -- 172.21.15.57:0/3934418372 learned_addr learned my addr 172.21.15.57:0/3934418372 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbccf89700 1 --2- 172.21.15.57:0/3934418372 >> v2:172.21.15.105:3300/0 conn(0x7fdbc80b7410 0x7fdbc8142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcd78a700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc80b7040 0x7fdbc8068fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 -- 172.21.15.57:0/3934418372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc80b7040 msgr2=0x7fdbc8068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc80b7040 0x7fdbc8068fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 -- 172.21.15.57:0/3934418372 >> v2:172.21.15.105:3300/0 conn(0x7fdbc80b7410 msgr2=0x7fdbc8142880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 --2- 172.21.15.57:0/3934418372 >> v2:172.21.15.105:3300/0 conn(0x7fdbc80b7410 0x7fdbc8142880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 -- 172.21.15.57:0/3934418372 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8068850 con 0x7fdbc8142dc0 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbcdf8b700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc8142dc0 0x7fdbc8145b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b7960 tx=0x7fdbc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb54424c444b1cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbbffff700 1 -- 172.21.15.57:0/3934418372 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000e070 con 0x7fdbc8142dc0 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbbffff700 1 -- 172.21.15.57:0/3934418372 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000ba50 con 0x7fdbc8142dc0 2023-10-06T03:53:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.531+0000 7fdbbffff700 1 -- 172.21.15.57:0/3934418372 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00092e0 con 0x7fdbc8142dc0 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- 172.21.15.57:0/3934418372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc8142dc0 msgr2=0x7fdbc8145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc8142dc0 0x7fdbc8145b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b7960 tx=0x7fdbc0009840 comp rx=0 tx=0).stop 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- 172.21.15.57:0/3934418372 shutdown_connections 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc8142dc0 0x7fdbc8145b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- 172.21.15.57:0/3934418372 >> v2:172.21.15.105:3300/0 conn(0x7fdbc80b7410 0x7fdbc8142880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- 172.21.15.57:0/3934418372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc80b7040 0x7fdbc8068fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- 172.21.15.57:0/3934418372 >> 172.21.15.57:0/3934418372 conn(0x7fdbc8067b10 msgr2=0x7fdbc80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- 172.21.15.57:0/3934418372 shutdown_connections 2023-10-06T03:53:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- 172.21.15.57:0/3934418372 wait complete. 2023-10-06T03:53:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 Processor -- start 2023-10-06T03:53:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- start start 2023-10-06T03:53:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc80b7040 0x7fdbc81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc8142dc0 0x7fdbc813d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8152f20 con 0x7fdbc80b7410 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc813cc00 con 0x7fdbc80b7040 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbce78c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc8152c40 con 0x7fdbc8142dc0 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44028/0 (socket says 172.21.15.57:44028) 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 -- 172.21.15.57:0/1294281551 learned_addr learned my addr 172.21.15.57:0/1294281551 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbcd78a700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc80b7040 0x7fdbc81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbcdf8b700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc8142dc0 0x7fdbc813d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 -- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc8142dc0 msgr2=0x7fdbc813d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc8142dc0 0x7fdbc813d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 -- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc80b7040 msgr2=0x7fdbc81522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc80b7040 0x7fdbc81522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.535+0000 7fdbccf89700 1 -- 172.21.15.57:0/1294281551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009ae0 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbccf89700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d890 tx=0x7fdbc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40125f0 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4012750 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc813f520 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4012af0 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc813e880 con 0x7fdbc80b7410 2023-10-06T03:53:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc813ea70 con 0x7fdbc80b7410 2023-10-06T03:53:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdbc401e460 con 0x7fdbc80b7410 2023-10-06T03:53:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 0x7fdbac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdbc407caf0 con 0x7fdbc80b7410 2023-10-06T03:53:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbcd78a700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 0x7fdbac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.539+0000 7fdbcd78a700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 0x7fdbac062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006fd0 tx=0x7fdbb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.547+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdbc404d2d0 con 0x7fdbc80b7410 2023-10-06T03:53:40.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.743+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbc806ab90 con 0x7fdbc80b7410 2023-10-06T03:53:40.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbbd7fa700 1 -- 172.21.15.57:0/1294281551 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2013 (secure 0 0 0) 0x7fdbc40508f0 con 0x7fdbc80b7410 2023-10-06T03:53:40.750 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:40.750 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":34133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 msgr2=0x7fdbac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 0x7fdbac062a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006fd0 tx=0x7fdbb8008040 comp rx=0 tx=0).stop 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 msgr2=0x7fdbc813d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400d890 tx=0x7fdbc4008040 comp rx=0 tx=0).stop 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 shutdown_connections 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdbac060550 0x7fdbac062a00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbc8142dc0 0x7fdbc813d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbc80b7410 0x7fdbc813d0e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 --2- 172.21.15.57:0/1294281551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc80b7040 0x7fdbc81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 >> 172.21.15.57:0/1294281551 conn(0x7fdbc8067b10 msgr2=0x7fdbc80b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 shutdown_connections 2023-10-06T03:53:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.747+0000 7fdbce78c700 1 -- 172.21.15.57:0/1294281551 wait complete. 2023-10-06T03:53:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2023-10-06T03:53:40.765 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 Processor -- start 2023-10-06T03:53:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 -- start start 2023-10-06T03:53:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02000ad750 0x7f020013ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0200143020 0x7f02000b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000a74c0 0x7f02000a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0200142b90 con 0x7f02000ad750 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020013f350 con 0x7f0200143020 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0206f0d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0200142540 con 0x7f02000a74c0 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.867+0000 7f0205f0b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02000ad750 0x7f020013ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02000ad750 0x7f020013ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44032/0 (socket says 172.21.15.57:44032) 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 -- 172.21.15.57:0/3949970452 learned_addr learned my addr 172.21.15.57:0/3949970452 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f020670c700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000a74c0 0x7f02000a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.874 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f020570a700 1 --2- 172.21.15.57:0/3949970452 >> v2:172.21.15.105:3300/0 conn(0x7f0200143020 0x7f02000b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 -- 172.21.15.57:0/3949970452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000a74c0 msgr2=0x7f02000a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000a74c0 0x7f02000a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 -- 172.21.15.57:0/3949970452 >> v2:172.21.15.105:3300/0 conn(0x7f0200143020 msgr2=0x7f02000b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 --2- 172.21.15.57:0/3949970452 >> v2:172.21.15.105:3300/0 conn(0x7f0200143020 0x7f02000b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 -- 172.21.15.57:0/3949970452 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200142820 con 0x7f02000ad750 2023-10-06T03:53:40.875 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0205f0b700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02000ad750 0x7f020013ee10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02000a8490 tx=0x7f01fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9201d243262ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0204f09700 1 -- 172.21.15.57:0/3949970452 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00b640 con 0x7f02000ad750 2023-10-06T03:53:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0204f09700 1 -- 172.21.15.57:0/3949970452 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00b7a0 con 0x7f02000ad750 2023-10-06T03:53:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0204f09700 1 -- 172.21.15.57:0/3949970452 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc00bb40 con 0x7f02000ad750 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 -- 172.21.15.57:0/3949970452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02000ad750 msgr2=0x7f020013ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02000ad750 0x7f020013ee10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02000a8490 tx=0x7f01fc009250 comp rx=0 tx=0).stop 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 -- 172.21.15.57:0/3949970452 shutdown_connections 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000a74c0 0x7f02000a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 --2- 172.21.15.57:0/3949970452 >> v2:172.21.15.105:3300/0 conn(0x7f0200143020 0x7f02000b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 --2- 172.21.15.57:0/3949970452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02000ad750 0x7f020013ee10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 -- 172.21.15.57:0/3949970452 >> 172.21.15.57:0/3949970452 conn(0x7f0200067070 msgr2=0x7f0200067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 -- 172.21.15.57:0/3949970452 shutdown_connections 2023-10-06T03:53:40.877 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.871+0000 7f0206f0d700 1 -- 172.21.15.57:0/3949970452 wait complete. 2023-10-06T03:53:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 Processor -- start 2023-10-06T03:53:40.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- start start 2023-10-06T03:53:40.879 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 0x7f02000a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000ad750 0x7f020013e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0200152c40 con 0x7f0200143020 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02001525f0 con 0x7f02000a74c0 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02001528d0 con 0x7f02000ad750 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44034/0 (socket says 172.21.15.57:44034) 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 -- 172.21.15.57:0/4197548585 learned_addr learned my addr 172.21.15.57:0/4197548585 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020570a700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000ad750 0x7f020013e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0205f0b700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 0x7f02000a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.880 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 -- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000ad750 msgr2=0x7f020013e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000ad750 0x7f020013e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 -- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 msgr2=0x7f02000a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 0x7f02000a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 -- 172.21.15.57:0/4197548585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0094f0 con 0x7f0200143020 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0205f0b700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 0x7f02000a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:40.881 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f020670c700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009e90 tx=0x7f01f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800cb50 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800f040 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200141440 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8014480 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.875+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0200152310 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200152df0 con 0x7f0200143020 2023-10-06T03:53:40.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f01f8014830 con 0x7f0200143020 2023-10-06T03:53:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f01f5ffb700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f01f807cfe0 con 0x7f0200143020 2023-10-06T03:53:40.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f0205f0b700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:40.884 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.879+0000 7f0205f0b700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 0x7f01e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02000a8490 tx=0x7f01fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:40.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:40.887+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0200152df0 con 0x7f0200143020 2023-10-06T03:53:41.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.051+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0200152df0 con 0x7f0200143020 2023-10-06T03:53:41.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.051+0000 7f01f5ffb700 1 -- 172.21.15.57:0/4197548585 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f0200152df0 con 0x7f0200143020 2023-10-06T03:53:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:41.057 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":21,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:40.475023+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 msgr2=0x7f01e4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 0x7f01e4062a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02000a8490 tx=0x7f01fc017000 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 msgr2=0x7f02000a5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009e90 tx=0x7f01f800b040 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 shutdown_connections 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f01e4060550 0x7f01e4062a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0200143020 0x7f02000a5050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02000ad750 0x7f020013e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 --2- 172.21.15.57:0/4197548585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02000a74c0 0x7f02000a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 >> 172.21.15.57:0/4197548585 conn(0x7f0200067070 msgr2=0x7f02000ac490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 shutdown_connections 2023-10-06T03:53:41.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.055+0000 7f0206f0d700 1 -- 172.21.15.57:0/4197548585 wait complete. 2023-10-06T03:53:41.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:53:32.687516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:53:38.405877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:53:41.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:53:41.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.183+0000 7fe5bd193700 1 Processor -- start 2023-10-06T03:53:41.189 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- start start 2023-10-06T03:53:41.190 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 0x7fe5b80b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5b8067440 0x7fe5b8142710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80b49e0 con 0x7fe5b80b0e60 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80b1fa0 con 0x7fe5b8067440 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b81421e0 con 0x7fe5b8067070 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b759e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe5b80b0e60 0x7fe5b81457e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49272/0 (socket says 172.21.15.57:49272) 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b759e700 1 -- 172.21.15.57:0/59119334 learned_addr learned my addr 172.21.15.57:0/59119334 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 --2- 172.21.15.57:0/59119334 >> v2:172.21.15.105:3300/0 conn(0x7fe5b8067440 0x7fe5b8142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.191 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b6d9d700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 0x7fe5b80b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b5d9b700 1 -- 172.21.15.57:0/59119334 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312480603 0 0) 0x7fe5b80b49e0 con 0x7fe5b80b0e60 2023-10-06T03:53:41.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b5d9b700 1 -- 172.21.15.57:0/59119334 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a0003570 con 0x7fe5b80b0e60 2023-10-06T03:53:41.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 -- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 msgr2=0x7fe5b80b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:41.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 0x7fe5b80b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 -- 172.21.15.57:0/59119334 >> v1:172.21.15.57:6789/0 conn(0x7fe5b80b0e60 legacy=0x7fe5b81457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 -- 172.21.15.57:0/59119334 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80b4c30 con 0x7fe5b8067440 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b6d9d700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 0x7fe5b80b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b659c700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b8142710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098e0 tx=0x7fe5a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb90e1f35b9984a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b5d9b700 1 -- 172.21.15.57:0/59119334 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011630 con 0x7fe5b8067440 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b5d9b700 1 -- 172.21.15.57:0/59119334 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8011790 con 0x7fe5b8067440 2023-10-06T03:53:41.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5b5d9b700 1 -- 172.21.15.57:0/59119334 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011b30 con 0x7fe5b8067440 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 msgr2=0x7fe5b8142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b8142710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098e0 tx=0x7fe5a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- 172.21.15.57:0/59119334 shutdown_connections 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b8142710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 --2- 172.21.15.57:0/59119334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b8067070 0x7fe5b80b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.187+0000 7fe5bd193700 1 -- 172.21.15.57:0/59119334 >> 172.21.15.57:0/59119334 conn(0x7fe5b80b8c90 msgr2=0x7fe5b80b9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- 172.21.15.57:0/59119334 shutdown_connections 2023-10-06T03:53:41.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- 172.21.15.57:0/59119334 wait complete. 2023-10-06T03:53:41.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 Processor -- start 2023-10-06T03:53:41.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- start start 2023-10-06T03:53:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 0x7fe5b8155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80a5960 con 0x7fe5b8067070 2023-10-06T03:53:41.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80af330 con 0x7fe5b8067440 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5bd193700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80a5c40 con 0x7fe5b80b0e60 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46570/0 (socket says 172.21.15.57:46570) 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 -- 172.21.15.57:0/1892778884 learned_addr learned my addr 172.21.15.57:0/1892778884 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b759e700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 0x7fe5b8155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b659c700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 -- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 msgr2=0x7fe5b8155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 0x7fe5b8155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 -- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 msgr2=0x7fe5b81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 -- 172.21.15.57:0/1892778884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009420 con 0x7fe5b8067070 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b759e700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 0x7fe5b8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe5b6d9d700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00ec80 tx=0x7fe5ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.191+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00c9d0 con 0x7fe5b8067070 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00cb30 con 0x7fe5b8067070 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a8009420 con 0x7fe5b8067070 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00ceb0 con 0x7fe5b8067070 2023-10-06T03:53:41.199 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80aefc0 con 0x7fe5b8067070 2023-10-06T03:53:41.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe5ac013680 con 0x7fe5b8067070 2023-10-06T03:53:41.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe59effd700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 0x7fe5a4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b804be00 con 0x7fe5b8067070 2023-10-06T03:53:41.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe5ac07ccf0 con 0x7fe5b8067070 2023-10-06T03:53:41.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe5b659c700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 0x7fe5a4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.195+0000 7fe5b659c700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 0x7fe5a4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80091e0 tx=0x7fe5a8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.203+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe5ac050f60 con 0x7fe5b8067070 2023-10-06T03:53:41.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.363+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5b80b4f10 con 0x7fe5b8067070 2023-10-06T03:53:41.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.363+0000 7fe59effd700 1 -- 172.21.15.57:0/1892778884 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5ac050af0 con 0x7fe5b8067070 2023-10-06T03:53:41.367 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 msgr2=0x7fe5a4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 0x7fe5a4062a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80091e0 tx=0x7fe5a8017000 comp rx=0 tx=0).stop 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 msgr2=0x7fe5b8145940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00ec80 tx=0x7fe5ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 shutdown_connections 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe5a4060550 0x7fe5a4062a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5b80b0e60 0x7fe5b8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5b8067440 0x7fe5b81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 --2- 172.21.15.57:0/1892778884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe5b8067070 0x7fe5b8145940 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 >> 172.21.15.57:0/1892778884 conn(0x7fe5b80b8c90 msgr2=0x7fe5b80b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 shutdown_connections 2023-10-06T03:53:41.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.367+0000 7fe5bd193700 1 -- 172.21.15.57:0/1892778884 wait complete. 2023-10-06T03:53:41.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:53:41.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 Processor -- start 2023-10-06T03:53:41.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 -- start start 2023-10-06T03:53:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fae2006f010 0x7fae20143830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae200b06e0 0x7fae20143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae20067a80 con 0x7fae20139db0 2023-10-06T03:53:41.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200b1780 con 0x7fae2006f010 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae260ae700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2013a8d0 con 0x7fae200b06e0 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fae2006f010 0x7fae20143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae258ad700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fae20139db0 0x7fae2013a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49274/0 (socket says 172.21.15.57:49274) 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fae2006f010 0x7fae20143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46582/0 (socket says 172.21.15.57:46582) 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae258ad700 1 -- 172.21.15.57:0/2398623951 learned_addr learned my addr 172.21.15.57:0/2398623951 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae248ab700 1 --2- 172.21.15.57:0/2398623951 >> v2:172.21.15.105:3300/0 conn(0x7fae200b06e0 0x7fae20143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 -- 172.21.15.57:0/2398623951 >> v2:172.21.15.105:3300/0 conn(0x7fae200b06e0 msgr2=0x7fae20143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 --2- 172.21.15.57:0/2398623951 >> v2:172.21.15.105:3300/0 conn(0x7fae200b06e0 0x7fae20143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 -- 172.21.15.57:0/2398623951 >> v1:172.21.15.57:6789/0 conn(0x7fae20139db0 legacy=0x7fae2013a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae17fff700 1 -- 172.21.15.57:0/2398623951 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265298414 0 0) 0x7fae20067a80 con 0x7fae20139db0 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 -- 172.21.15.57:0/2398623951 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200b1130 con 0x7fae2006f010 2023-10-06T03:53:41.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae250ac700 1 --2- 172.21.15.57:0/2398623951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2006f010 0x7fae20143830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae200acb20 tx=0x7fae100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9377a275d8b9baeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae17fff700 1 -- 172.21.15.57:0/2398623951 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10011630 con 0x7fae2006f010 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae17fff700 1 -- 172.21.15.57:0/2398623951 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10011790 con 0x7fae2006f010 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.483+0000 7fae17fff700 1 -- 172.21.15.57:0/2398623951 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10011b30 con 0x7fae2006f010 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- 172.21.15.57:0/2398623951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2006f010 msgr2=0x7fae20143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- 172.21.15.57:0/2398623951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2006f010 0x7fae20143830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae200acb20 tx=0x7fae100091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- 172.21.15.57:0/2398623951 shutdown_connections 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- 172.21.15.57:0/2398623951 >> v2:172.21.15.105:3300/0 conn(0x7fae200b06e0 0x7fae20143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- 172.21.15.57:0/2398623951 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae2006f010 0x7fae20143830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- 172.21.15.57:0/2398623951 >> 172.21.15.57:0/2398623951 conn(0x7fae20068180 msgr2=0x7fae20068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- 172.21.15.57:0/2398623951 shutdown_connections 2023-10-06T03:53:41.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- 172.21.15.57:0/2398623951 wait complete. 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 Processor -- start 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- start start 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 0x7fae2013f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 0x7fae20150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae20154380 con 0x7fae20139db0 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae20153a30 con 0x7fae200b06e0 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae260ae700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae20153cc0 con 0x7fae2006f010 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46588/0 (socket says 172.21.15.57:46588) 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 -- 172.21.15.57:0/1737030693 learned_addr learned my addr 172.21.15.57:0/1737030693 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae248ab700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 0x7fae20150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae250ac700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 0x7fae2013f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 -- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 msgr2=0x7fae2013f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 0x7fae2013f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 -- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 msgr2=0x7fae20150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 0x7fae20150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 -- 172.21.15.57:0/1737030693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009420 con 0x7fae20139db0 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae250ac700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 0x7fae2013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:41.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae248ab700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 0x7fae20150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.487+0000 7fae258ad700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c530 tx=0x7fae1c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c005b30 con 0x7fae20139db0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c005c90 con 0x7fae20139db0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae20153fa0 con 0x7fae20139db0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c007320 con 0x7fae20139db0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2013fbd0 con 0x7fae20139db0 2023-10-06T03:53:41.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.491+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2006c460 con 0x7fae20139db0 2023-10-06T03:53:41.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.495+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fae1c01b3b0 con 0x7fae20139db0 2023-10-06T03:53:41.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.499+0000 7fae157fa700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 0x7fae04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.499+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fae1c07c080 con 0x7fae20139db0 2023-10-06T03:53:41.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.499+0000 7fae250ac700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 0x7fae04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.499+0000 7fae250ac700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 0x7fae04062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae100093f0 tx=0x7fae10017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.507+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fae1c04c7c0 con 0x7fae20139db0 2023-10-06T03:53:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.667+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae200ad3e0 con 0x7fae20139db0 2023-10-06T03:53:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae157fa700 1 -- 172.21.15.57:0/1737030693 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae1c017020 con 0x7fae20139db0 2023-10-06T03:53:41.674 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:53:41.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 msgr2=0x7fae04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 0x7fae04062a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae100093f0 tx=0x7fae10017000 comp rx=0 tx=0).stop 2023-10-06T03:53:41.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 msgr2=0x7fae20150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00c530 tx=0x7fae1c007f90 comp rx=0 tx=0).stop 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 shutdown_connections 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fae04060550 0x7fae04062a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae20139db0 0x7fae20150740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae200b06e0 0x7fae20150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 --2- 172.21.15.57:0/1737030693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae2006f010 0x7fae2013f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 >> 172.21.15.57:0/1737030693 conn(0x7fae20068180 msgr2=0x7fae20134f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 shutdown_connections 2023-10-06T03:53:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.671+0000 7fae260ae700 1 -- 172.21.15.57:0/1737030693 wait complete. 2023-10-06T03:53:41.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:53:41.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.787+0000 7f96a556a700 1 Processor -- start 2023-10-06T03:53:41.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.787+0000 7f96a556a700 1 -- start start 2023-10-06T03:53:41.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96a00b0950 0x7f96a00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00b20e0 con 0x7f96a01464c0 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00ac360 con 0x7f96a0142340 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a01459e0 con 0x7f96a00b0950 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f96a01464c0 0x7f96a00b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49282/0 (socket says 172.21.15.57:49282) 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969f7fe700 1 -- 172.21.15.57:0/2022479710 learned_addr learned my addr 172.21.15.57:0/2022479710 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969ffff700 1 --2- 172.21.15.57:0/2022479710 >> v2:172.21.15.57:3300/0 conn(0x7f96a00b0950 0x7f96a00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313158178 0 0) 0x7f96a00b20e0 con 0x7f96a01464c0 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9688003570 con 0x7f96a01464c0 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754230344 0 0) 0x7f96a00ac360 con 0x7f96a0142340 2023-10-06T03:53:41.795 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969ffff700 1 -- 172.21.15.57:0/2022479710 >> v1:172.21.15.105:6789/0 conn(0x7f96a0142340 legacy=0x7f96a01427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969ffff700 1 -- 172.21.15.57:0/2022479710 >> v1:172.21.15.57:6789/0 conn(0x7f96a01464c0 legacy=0x7f96a00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.796 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969ffff700 1 -- 172.21.15.57:0/2022479710 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0145cc0 con 0x7f96a00b0950 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969ffff700 1 --2- 172.21.15.57:0/2022479710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a00b27e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96940098e0 tx=0x7f96940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f93fa81da3fe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690001470 con 0x7f96a00b0950 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9694011420 con 0x7f96a00b0950 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f969effd700 1 -- 172.21.15.57:0/2022479710 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940117a0 con 0x7f96a00b0950 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- 172.21.15.57:0/2022479710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 msgr2=0x7f96a00b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 --2- 172.21.15.57:0/2022479710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a00b27e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96940098e0 tx=0x7f96940091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- 172.21.15.57:0/2022479710 shutdown_connections 2023-10-06T03:53:41.797 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 --2- 172.21.15.57:0/2022479710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a00b27e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- 172.21.15.57:0/2022479710 >> 172.21.15.57:0/2022479710 conn(0x7f96a0068f20 msgr2=0x7f96a0069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- 172.21.15.57:0/2022479710 shutdown_connections 2023-10-06T03:53:41.798 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.791+0000 7f96a556a700 1 -- 172.21.15.57:0/2022479710 wait complete. 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 Processor -- start 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- start start 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 0x7f96a013f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 0x7f96a013dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0156700 con 0x7f96a00b0950 2023-10-06T03:53:41.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a01569e0 con 0x7f96a0142340 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a013cca0 con 0x7f96a01464c0 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46598/0 (socket says 172.21.15.57:46598) 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 -- 172.21.15.57:0/2950289137 learned_addr learned my addr 172.21.15.57:0/2950289137 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a4d69700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 0x7f96a013dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969f7fe700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 0x7f96a013f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 -- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 msgr2=0x7f96a013dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 0x7f96a013dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 -- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 msgr2=0x7f96a013f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 0x7f96a013f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 -- 172.21.15.57:0/2950289137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009420 con 0x7f96a00b0950 2023-10-06T03:53:41.801 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969f7fe700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 0x7f96a013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a4d69700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 0x7f96a013dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f969ffff700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96a01469b0 tx=0x7f9694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694010be0 con 0x7f96a00b0950 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9694010d40 con 0x7f96a00b0950 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a013ce60 con 0x7f96a00b0950 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969401d640 con 0x7f96a00b0950 2023-10-06T03:53:41.802 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a0156450 con 0x7f96a00b0950 2023-10-06T03:53:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.795+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a0156840 con 0x7f96a00b0950 2023-10-06T03:53:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.799+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f969401da30 con 0x7f96a00b0950 2023-10-06T03:53:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.799+0000 7f9687fff700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 0x7f968c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.799+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f969407e120 con 0x7f96a00b0950 2023-10-06T03:53:41.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.799+0000 7f969f7fe700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 0x7f968c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:41.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.799+0000 7f969f7fe700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 0x7f968c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96900011e0 tx=0x7f9690009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:41.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.807+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f96a0156840 con 0x7f96a00b0950 2023-10-06T03:53:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.967+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f96a00b58e0 con 0x7f96a00b0950 2023-10-06T03:53:41.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f9687fff700 1 -- 172.21.15.57:0/2950289137 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7f96a00b58e0 con 0x7f96a00b0950 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2023-10-06T03:53:41.974 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2023-10-06T03:53:41.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-10-06T03:53:41.975 INFO:teuthology.orchestra.run.smithi057.stdout:] 2023-10-06T03:53:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 msgr2=0x7f968c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 0x7f968c062a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96900011e0 tx=0x7f9690009040 comp rx=0 tx=0).stop 2023-10-06T03:53:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 msgr2=0x7f96a013ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f96a01469b0 tx=0x7f9694017000 comp rx=0 tx=0).stop 2023-10-06T03:53:41.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 shutdown_connections 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f968c060550 0x7f968c062a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96a01464c0 0x7f96a013dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a0142340 0x7f96a013f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 --2- 172.21.15.57:0/2950289137 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96a00b0950 0x7f96a013ef40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 >> 172.21.15.57:0/2950289137 conn(0x7f96a0068f20 msgr2=0x7f96a0141210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 shutdown_connections 2023-10-06T03:53:41.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:41.971+0000 7f96a556a700 1 -- 172.21.15.57:0/2950289137 wait complete. 2023-10-06T03:53:41.988 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:53:41.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:53:42.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 Processor -- start 2023-10-06T03:53:42.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 -- start start 2023-10-06T03:53:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 0x7f13300b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f13301426d0 0x7f1330142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300b35e0 con 0x7f133013be00 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13300b3000 con 0x7f13300b6b10 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1334df4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133013c900 con 0x7f13301426d0 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 0x7f13300b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f133013be00 0x7f133013c1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49294/0 (socket says 172.21.15.57:49294) 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132ffff700 1 -- 172.21.15.57:0/2691924378 learned_addr learned my addr 172.21.15.57:0/2691924378 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:42.104 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 --2- 172.21.15.57:0/2691924378 >> v2:172.21.15.105:3300/0 conn(0x7f13301426d0 0x7f1330142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 -- 172.21.15.57:0/2691924378 >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 msgr2=0x7f13300b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:42.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 --2- 172.21.15.57:0/2691924378 >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 0x7f13300b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 -- 172.21.15.57:0/2691924378 >> v1:172.21.15.57:6789/0 conn(0x7f133013be00 legacy=0x7f133013c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 -- 172.21.15.57:0/2691924378 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300b3270 con 0x7f13301426d0 2023-10-06T03:53:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132effd700 1 -- 172.21.15.57:0/2691924378 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854740355 0 0) 0x7f13300b35e0 con 0x7f133013be00 2023-10-06T03:53:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132f7fe700 1 --2- 172.21.15.57:0/2691924378 >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 0x7f13300b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:42.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f1327fff700 1 --2- 172.21.15.57:0/2691924378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13301426d0 0x7f1330142b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13300ad8f0 tx=0x7f13180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=827508dc195f74f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132effd700 1 -- 172.21.15.57:0/2691924378 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318011630 con 0x7f13301426d0 2023-10-06T03:53:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132effd700 1 -- 172.21.15.57:0/2691924378 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318011790 con 0x7f13301426d0 2023-10-06T03:53:42.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.099+0000 7f132effd700 1 -- 172.21.15.57:0/2691924378 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318011b30 con 0x7f13301426d0 2023-10-06T03:53:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- 172.21.15.57:0/2691924378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13301426d0 msgr2=0x7f1330142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 --2- 172.21.15.57:0/2691924378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13301426d0 0x7f1330142b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13300ad8f0 tx=0x7f13180091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- 172.21.15.57:0/2691924378 shutdown_connections 2023-10-06T03:53:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 --2- 172.21.15.57:0/2691924378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13301426d0 0x7f1330142b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 --2- 172.21.15.57:0/2691924378 >> v2:172.21.15.57:3300/0 conn(0x7f13300b6b10 0x7f13300b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- 172.21.15.57:0/2691924378 >> 172.21.15.57:0/2691924378 conn(0x7f133006ddf0 msgr2=0x7f133006e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- 172.21.15.57:0/2691924378 shutdown_connections 2023-10-06T03:53:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- 172.21.15.57:0/2691924378 wait complete. 2023-10-06T03:53:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 Processor -- start 2023-10-06T03:53:42.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.103+0000 7f1334df4700 1 -- start start 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 0x7f1330152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f13301426d0 0x7f13301527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133013f690 con 0x7f13300b6b10 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330145250 con 0x7f133013be00 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133013e460 con 0x7f13301426d0 2023-10-06T03:53:42.112 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46614/0 (socket says 172.21.15.57:46614) 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 -- 172.21.15.57:0/3595139227 learned_addr learned my addr 172.21.15.57:0/3595139227 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1327fff700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 0x7f1330152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132ffff700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f13301426d0 0x7f13301527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 -- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f13301426d0 msgr2=0x7f13301527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f13301426d0 0x7f13301527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 -- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 msgr2=0x7f1330152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 0x7f1330152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 -- 172.21.15.57:0/3595139227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009420 con 0x7f13300b6b10 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1327fff700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 0x7f1330152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f132f7fe700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f132000ecb0 tx=0x7f13200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.113 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132000ee60 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132000cbe0 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318009420 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320013470 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133013e0d0 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.107+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133006d8f0 con 0x7f13300b6b10 2023-10-06T03:53:42.114 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.111+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1320013820 con 0x7f13300b6b10 2023-10-06T03:53:42.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.111+0000 7f13277fe700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 0x7f1310062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.111+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f132007c9d0 con 0x7f13300b6b10 2023-10-06T03:53:42.115 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.111+0000 7f1327fff700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 0x7f1310062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.117 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.111+0000 7f1327fff700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 0x7f1310062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13180091e0 tx=0x7f1318017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.124 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.119+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f132004d1b0 con 0x7f13300b6b10 2023-10-06T03:53:42.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.275+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f13300b6ee0 con 0x7f13300b6b10 2023-10-06T03:53:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.619+0000 7f13277fe700 1 -- 172.21.15.57:0/3595139227 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13200507d0 con 0x7f13300b6b10 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 msgr2=0x7f1310062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 0x7f1310062a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13180091e0 tx=0x7f1318017000 comp rx=0 tx=0).stop 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 msgr2=0x7f133013db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f132000ecb0 tx=0x7f13200091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 shutdown_connections 2023-10-06T03:53:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1310060550 0x7f1310062a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f13301426d0 0x7f13301527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f133013be00 0x7f1330152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 --2- 172.21.15.57:0/3595139227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13300b6b10 0x7f133013db90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.623+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 >> 172.21.15.57:0/3595139227 conn(0x7f133006ddf0 msgr2=0x7f13300b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.627+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 shutdown_connections 2023-10-06T03:53:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.627+0000 7f1334df4700 1 -- 172.21.15.57:0/3595139227 wait complete. 2023-10-06T03:53:42.632 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2023-10-06T03:53:42.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:53:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.759+0000 7f9a1caa2700 1 Processor -- start 2023-10-06T03:53:42.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.759+0000 7f9a1caa2700 1 -- start start 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a180a9fd0 0x7f9a18142760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a181422d0 con 0x7f9a18137ec0 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a180b1470 con 0x7f9a180aa3a0 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a18141c80 con 0x7f9a180a9fd0 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a177fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a180a9fd0 0x7f9a18142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a17fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a18137ec0 0x7f9a18138320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49308/0 (socket says 172.21.15.57:49308) 2023-10-06T03:53:42.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a17fff700 1 -- 172.21.15.57:0/3539950089 learned_addr learned my addr 172.21.15.57:0/3539950089 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a16ffd700 1 -- 172.21.15.57:0/3539950089 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982771246 0 0) 0x7f9a181422d0 con 0x7f9a18137ec0 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a16ffd700 1 -- 172.21.15.57:0/3539950089 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a04004680 con 0x7f9a18137ec0 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a177fe700 1 -- 172.21.15.57:0/3539950089 >> v1:172.21.15.105:6789/0 conn(0x7f9a180aa3a0 legacy=0x7f9a1806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a177fe700 1 -- 172.21.15.57:0/3539950089 >> v1:172.21.15.57:6789/0 conn(0x7f9a18137ec0 legacy=0x7f9a18138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a177fe700 1 -- 172.21.15.57:0/3539950089 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18141f60 con 0x7f9a180a9fd0 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a177fe700 1 --2- 172.21.15.57:0/3539950089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18142760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f723815c9b94355 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a16ffd700 1 -- 172.21.15.57:0/3539950089 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800b640 con 0x7f9a180a9fd0 2023-10-06T03:53:42.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a16ffd700 1 -- 172.21.15.57:0/3539950089 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800b7a0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a16ffd700 1 -- 172.21.15.57:0/3539950089 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800bb40 con 0x7f9a180a9fd0 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- 172.21.15.57:0/3539950089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 msgr2=0x7f9a18142760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/3539950089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18142760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098e0 tx=0x7f9a080091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- 172.21.15.57:0/3539950089 shutdown_connections 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/3539950089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18142760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- 172.21.15.57:0/3539950089 >> 172.21.15.57:0/3539950089 conn(0x7f9a180b1b30 msgr2=0x7f9a180b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- 172.21.15.57:0/3539950089 shutdown_connections 2023-10-06T03:53:42.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.763+0000 7f9a1caa2700 1 -- 172.21.15.57:0/3539950089 wait complete. 2023-10-06T03:53:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 Processor -- start 2023-10-06T03:53:42.771 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 -- start start 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a180aa3a0 0x7f9a1813c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a18137ec0 0x7f9a1813ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1813e2c0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a181393f0 con 0x7f9a180aa3a0 2023-10-06T03:53:42.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a1caa2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1813a0d0 con 0x7f9a18137ec0 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46636/0 (socket says 172.21.15.57:46636) 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 -- 172.21.15.57:0/1043500280 learned_addr learned my addr 172.21.15.57:0/1043500280 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a0effd700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a180aa3a0 0x7f9a1813c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a17fff700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a18137ec0 0x7f9a1813ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 -- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a18137ec0 msgr2=0x7f9a1813ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a18137ec0 0x7f9a1813ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 -- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a180aa3a0 msgr2=0x7f9a1813c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a180aa3a0 0x7f9a1813c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.767+0000 7f9a177fe700 1 -- 172.21.15.57:0/1043500280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009420 con 0x7f9a180a9fd0 2023-10-06T03:53:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a177fe700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009f80 tx=0x7f9a08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08000d10 con 0x7f9a180a9fd0 2023-10-06T03:53:42.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800bb20 con 0x7f9a180a9fd0 2023-10-06T03:53:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1813a3b0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011650 con 0x7f9a180a9fd0 2023-10-06T03:53:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1813e510 con 0x7f9a180a9fd0 2023-10-06T03:53:42.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.771+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9a080119c0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.775+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1804be00 con 0x7f9a180a9fd0 2023-10-06T03:53:42.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.775+0000 7f9a0ffff700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 0x7f99f8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.775+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f9a0807daf0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.775+0000 7f9a0effd700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 0x7f99f8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:42.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.775+0000 7f9a0effd700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 0x7f99f8062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a181455d0 tx=0x7f9a00007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:42.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.779+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9a0804e1c0 con 0x7f9a180a9fd0 2023-10-06T03:53:42.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:42.947+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9a180b3b50 con 0x7f9a180a9fd0 2023-10-06T03:53:43.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.631+0000 7f9a0ffff700 1 -- 172.21.15.57:0/1043500280 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9a080517e0 con 0x7f9a180a9fd0 2023-10-06T03:53:43.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 msgr2=0x7f99f8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 0x7f99f8062a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a181455d0 tx=0x7f9a00007ec0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 msgr2=0x7f9a18144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009f80 tx=0x7f9a08017000 comp rx=0 tx=0).stop 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 shutdown_connections 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f99f8060580 0x7f99f8062a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a18137ec0 0x7f9a1813ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a180aa3a0 0x7f9a1813c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 --2- 172.21.15.57:0/1043500280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a180a9fd0 0x7f9a18144dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 >> 172.21.15.57:0/1043500280 conn(0x7f9a180b1b30 msgr2=0x7f9a18062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 shutdown_connections 2023-10-06T03:53:43.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.651+0000 7f9a1caa2700 1 -- 172.21.15.57:0/1043500280 wait complete. 2023-10-06T03:53:43.658 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2023-10-06T03:53:43.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:53:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.775+0000 7f1900cf3700 1 Processor -- start 2023-10-06T03:53:43.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.775+0000 7f1900cf3700 1 -- start start 2023-10-06T03:53:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f1900cf3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc06c380 0x7f18fc13be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f1900cf3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18fc0b1570 0x7f18fc13c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f1900cf3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc146130 con 0x7f18fc0701c0 2023-10-06T03:53:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f1900cf3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0b0d40 con 0x7f18fc0b1570 2023-10-06T03:53:43.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f1900cf3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc1465c0 con 0x7f18fc06c380 2023-10-06T03:53:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18fc0b1570 0x7f18fc13c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f18fc0701c0 0x7f18fc0afdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49324/0 (socket says 172.21.15.57:49324) 2023-10-06T03:53:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18fc0b1570 0x7f18fc13c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46642/0 (socket says 172.21.15.57:46642) 2023-10-06T03:53:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fb7fe700 1 -- 172.21.15.57:0/1376281569 learned_addr learned my addr 172.21.15.57:0/1376281569 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:43.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18f2ffd700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc06c380 0x7f18fc13be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 -- 172.21.15.57:0/1376281569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc06c380 msgr2=0x7f18fc13be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18faffd700 1 -- 172.21.15.57:0/1376281569 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462771117 0 0) 0x7f18fc146130 con 0x7f18fc0701c0 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc06c380 0x7f18fc13be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 -- 172.21.15.57:0/1376281569 >> v1:172.21.15.57:6789/0 conn(0x7f18fc0701c0 legacy=0x7f18fc0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 -- 172.21.15.57:0/1376281569 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc145ae0 con 0x7f18fc0b1570 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18fbfff700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0b1570 0x7f18fc13c3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e90 tx=0x7f18f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db71c89ba88f42ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18faffd700 1 -- 172.21.15.57:0/1376281569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400e070 con 0x7f18fc0b1570 2023-10-06T03:53:43.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18faffd700 1 -- 172.21.15.57:0/1376281569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400bbf0 con 0x7f18fc0b1570 2023-10-06T03:53:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.779+0000 7f18faffd700 1 -- 172.21.15.57:0/1376281569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4012430 con 0x7f18fc0b1570 2023-10-06T03:53:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- 172.21.15.57:0/1376281569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0b1570 msgr2=0x7f18fc13c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0b1570 0x7f18fc13c3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e90 tx=0x7f18f4009780 comp rx=0 tx=0).stop 2023-10-06T03:53:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- 172.21.15.57:0/1376281569 shutdown_connections 2023-10-06T03:53:43.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc06c380 0x7f18fc13be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- 172.21.15.57:0/1376281569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0b1570 0x7f18fc13c3a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- 172.21.15.57:0/1376281569 >> 172.21.15.57:0/1376281569 conn(0x7f18fc0b1a90 msgr2=0x7f18fc0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- 172.21.15.57:0/1376281569 shutdown_connections 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- 172.21.15.57:0/1376281569 wait complete. 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 Processor -- start 2023-10-06T03:53:43.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- start start 2023-10-06T03:53:43.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18fc06c380 0x7f18fc13ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc0b1570 0x7f18fc13a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc144d50 con 0x7f18fc0701c0 2023-10-06T03:53:43.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc140cc0 con 0x7f18fc06c380 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f1900cf3700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc142470 con 0x7f18fc0b1570 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46656/0 (socket says 172.21.15.57:46656) 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 -- 172.21.15.57:0/3333886041 learned_addr learned my addr 172.21.15.57:0/3333886041 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18fb7fe700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18fc06c380 0x7f18fc13ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18fbfff700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc0b1570 0x7f18fc13a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 -- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc0b1570 msgr2=0x7f18fc13a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc0b1570 0x7f18fc13a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 -- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18fc06c380 msgr2=0x7f18fc13ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18fc06c380 0x7f18fc13ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.783+0000 7f18f2ffd700 1 -- 172.21.15.57:0/3333886041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4009a20 con 0x7f18fc0701c0 2023-10-06T03:53:43.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f2ffd700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ec80 tx=0x7f18e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400c850 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e400c9b0 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc142750 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400cd50 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc145280 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc06b9a0 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f18e4013680 con 0x7f18fc0701c0 2023-10-06T03:53:43.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 0x7f18dc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f18e407cc30 con 0x7f18fc0701c0 2023-10-06T03:53:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.787+0000 7f18fb7fe700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 0x7f18dc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:43.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.791+0000 7f18fb7fe700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 0x7f18dc062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18ec001360 tx=0x7f18ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:43.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.799+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f18e404d120 con 0x7f18fc0701c0 2023-10-06T03:53:43.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:43.995+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18fc145dc0 con 0x7f18fc0701c0 2023-10-06T03:53:44.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.635+0000 7f18f3fff700 1 -- 172.21.15.57:0/3333886041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18e4050740 con 0x7f18fc0701c0 2023-10-06T03:53:44.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 msgr2=0x7f18dc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 0x7f18dc062a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18ec001360 tx=0x7f18ec009040 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 msgr2=0x7f18fc1411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ec80 tx=0x7f18e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 shutdown_connections 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f18dc060550 0x7f18dc062a00 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18ec001360 tx=0x7f18ec009040 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18fc0b1570 0x7f18fc13a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18fc0701c0 0x7f18fc1411a0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ec80 tx=0x7f18e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 --2- 172.21.15.57:0/3333886041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18fc06c380 0x7f18fc13ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.643+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 >> 172.21.15.57:0/3333886041 conn(0x7f18fc0b1a90 msgr2=0x7f18fc0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.647+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 shutdown_connections 2023-10-06T03:53:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.647+0000 7f1900cf3700 1 -- 172.21.15.57:0/3333886041 wait complete. 2023-10-06T03:53:44.658 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:53:44.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.767+0000 7fe4b0d3e700 1 Processor -- start 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.767+0000 7fe4b0d3e700 1 -- start start 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0b08f0 0x7fe4ac1422e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4ac0b2cd0 0x7fe4ac142820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0b4a70 con 0x7fe4ac0672a0 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0b0e10 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0b10f0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aa59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe4ac0672a0 0x7fe4ac0b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49328/0 (socket says 172.21.15.57:49328) 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aa59c700 1 -- 172.21.15.57:0/3189971412 learned_addr learned my addr 172.21.15.57:0/3189971412 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 --2- 172.21.15.57:0/3189971412 >> v2:172.21.15.57:3300/0 conn(0x7fe4ac0b2cd0 0x7fe4ac142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a9d9b700 1 --2- 172.21.15.57:0/3189971412 >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0b08f0 0x7fe4ac1422e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003020463 0 0) 0x7fe4ac0b4a70 con 0x7fe4ac0672a0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe498003570 con 0x7fe4ac0672a0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 -- 172.21.15.57:0/3189971412 >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0b08f0 msgr2=0x7fe4ac1422e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 --2- 172.21.15.57:0/3189971412 >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0b08f0 0x7fe4ac1422e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 -- 172.21.15.57:0/3189971412 >> v1:172.21.15.57:6789/0 conn(0x7fe4ac0672a0 legacy=0x7fe4ac0b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807125031 0 0) 0x7fe498003570 con 0x7fe4ac0672a0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 -- 172.21.15.57:0/3189971412 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac067670 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4aad9d700 1 --2- 172.21.15.57:0/3189971412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b2cd0 0x7fe4ac142820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40098e0 tx=0x7fe4a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e41c2ce25b2be5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:44.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0017f0 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a4011420 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4a959a700 1 -- 172.21.15.57:0/3189971412 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40117c0 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/3189971412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b2cd0 msgr2=0x7fe4ac142820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/3189971412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b2cd0 0x7fe4ac142820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40098e0 tx=0x7fe4a40091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/3189971412 shutdown_connections 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/3189971412 >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0b08f0 0x7fe4ac1422e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/3189971412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b2cd0 0x7fe4ac142820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/3189971412 >> 172.21.15.57:0/3189971412 conn(0x7fe4ac0b8c90 msgr2=0x7fe4ac0b9090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/3189971412 shutdown_connections 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/3189971412 wait complete. 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 Processor -- start 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.771+0000 7fe4b0d3e700 1 -- start start 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0672a0 0x7fe4ac1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac0b2cd0 0x7fe4ac0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0ad3f0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac144780 con 0x7fe4ac0672a0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac0aeec0 con 0x7fe4ac0b2cd0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46682/0 (socket says 172.21.15.57:46682) 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 -- 172.21.15.57:0/575456541 learned_addr learned my addr 172.21.15.57:0/575456541 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4aad9d700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac0b2cd0 0x7fe4ac0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4aa59c700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0672a0 0x7fe4ac1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 -- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac0b2cd0 msgr2=0x7fe4ac0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac0b2cd0 0x7fe4ac0aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 -- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0672a0 msgr2=0x7fe4ac1425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0672a0 0x7fe4ac1425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 -- 172.21.15.57:0/575456541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4009420 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a9d9b700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe49400ec80 tx=0x7fe4940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400c9d0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400cb30 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac0af1a0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494013470 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac0af760 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac0ac670 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.775+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe494013820 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.779+0000 7fe4a27fc700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 0x7fe48c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.779+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe49407cbf0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.779+0000 7fe4aa59c700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 0x7fe48c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:44.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.779+0000 7fe4aa59c700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 0x7fe48c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe49c001560 tx=0x7fe49c0018a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:44.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.783+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe49404d080 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.943+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4ac04be00 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.947+0000 7fe4a27fc700 1 -- 172.21.15.57:0/575456541 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fe4940506a0 con 0x7fe4ac0b08f0 2023-10-06T03:53:44.952 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:44.952 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:43.999277+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 msgr2=0x7fe48c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 0x7fe48c062a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe49c001560 tx=0x7fe49c0018a0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 msgr2=0x7fe4ac0ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe49400ec80 tx=0x7fe4940091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 shutdown_connections 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe48c060550 0x7fe48c062a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac0b2cd0 0x7fe4ac0aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4ac0b08f0 0x7fe4ac0ac970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 --2- 172.21.15.57:0/575456541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0672a0 0x7fe4ac1425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:44.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 >> 172.21.15.57:0/575456541 conn(0x7fe4ac0b8c90 msgr2=0x7fe4ac0b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:44.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 shutdown_connections 2023-10-06T03:53:44.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:44.951+0000 7fe4b0d3e700 1 -- 172.21.15.57:0/575456541 wait complete. 2023-10-06T03:53:44.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:45.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 Processor -- start 2023-10-06T03:53:45.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 -- start start 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c7406f2e0 0x7f2c740aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c74143f30 con 0x7f2c740a7df0 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740a9410 con 0x7f2c740add20 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c7359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c740a9230 con 0x7f2c7406f2e0 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c71d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c740a7df0 0x7f2c7406ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49332/0 (socket says 172.21.15.57:49332) 2023-10-06T03:53:45.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.067+0000 7f2c71d9b700 1 -- 172.21.15.57:0/1193759328 learned_addr learned my addr 172.21.15.57:0/1193759328 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c72d9d700 1 --2- 172.21.15.57:0/1193759328 >> v2:172.21.15.105:3300/0 conn(0x7f2c7406f2e0 0x7f2c740aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089342913 0 0) 0x7f2c74143f30 con 0x7f2c740a7df0 2023-10-06T03:53:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c5c003570 con 0x7f2c740a7df0 2023-10-06T03:53:45.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c72d9d700 1 -- 172.21.15.57:0/1193759328 >> v1:172.21.15.105:6789/0 conn(0x7f2c740add20 legacy=0x7f2c7413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777305160 0 0) 0x7f2c5c003570 con 0x7f2c740a7df0 2023-10-06T03:53:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c72d9d700 1 -- 172.21.15.57:0/1193759328 >> v1:172.21.15.57:6789/0 conn(0x7f2c740a7df0 legacy=0x7f2c7406ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c72d9d700 1 -- 172.21.15.57:0/1193759328 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c741443c0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c72d9d700 1 --2- 172.21.15.57:0/1193759328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c7406f2e0 0x7f2c740aa920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009e60 tx=0x7f2c6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ec35e5b7df5d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00e070 con 0x7f2c7406f2e0 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c00b850 con 0x7f2c7406f2e0 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7159a700 1 -- 172.21.15.57:0/1193759328 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64001470 con 0x7f2c7406f2e0 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 -- 172.21.15.57:0/1193759328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c7406f2e0 msgr2=0x7f2c740aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 --2- 172.21.15.57:0/1193759328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c7406f2e0 0x7f2c740aa920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009e60 tx=0x7f2c6c009780 comp rx=0 tx=0).stop 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 -- 172.21.15.57:0/1193759328 shutdown_connections 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 --2- 172.21.15.57:0/1193759328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c7406f2e0 0x7f2c740aa920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 -- 172.21.15.57:0/1193759328 >> 172.21.15.57:0/1193759328 conn(0x7f2c74067070 msgr2=0x7f2c74067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:45.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 -- 172.21.15.57:0/1193759328 shutdown_connections 2023-10-06T03:53:45.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.071+0000 7f2c7359e700 1 -- 172.21.15.57:0/1193759328 wait complete. 2023-10-06T03:53:45.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 Processor -- start 2023-10-06T03:53:45.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 -- start start 2023-10-06T03:53:45.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.081 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 0x7f2c740a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 0x7f2c740a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741439e0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7406e120 con 0x7f2c740a7df0 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c740a4490 con 0x7f2c740add20 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46698/0 (socket says 172.21.15.57:46698) 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 -- 172.21.15.57:0/692964024 learned_addr learned my addr 172.21.15.57:0/692964024 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c71d9b700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 0x7f2c740a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c72d9d700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 0x7f2c740a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 -- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 msgr2=0x7f2c740a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.082 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 0x7f2c740a5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 -- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 msgr2=0x7f2c740a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 0x7f2c740a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c7259c700 1 -- 172.21.15.57:0/692964024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c009a20 con 0x7f2c7406f2e0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c72d9d700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 0x7f2c740a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.075+0000 7f2c71d9b700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 0x7f2c740a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c7259c700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c5c0 tx=0x7f2c6800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011590 con 0x7f2c7406f2e0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68011710 con 0x7f2c7406f2e0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011ad0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c740a6220 con 0x7f2c7406f2e0 2023-10-06T03:53:45.083 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c740a49c0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7406b3a0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.079+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2c6801b3b0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.083+0000 7f2c627fc700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 0x7f2c54062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.083+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c6807bf60 con 0x7f2c7406f2e0 2023-10-06T03:53:45.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.083+0000 7f2c71d9b700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 0x7f2c54062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.087 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.083+0000 7f2c71d9b700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 0x7f2c54062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c741404b0 tx=0x7f2c64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.091+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2c6804c3f0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.263 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.259+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c74143bc0 con 0x7f2c7406f2e0 2023-10-06T03:53:45.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.259+0000 7f2c627fc700 1 -- 172.21.15.57:0/692964024 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f2c68017070 con 0x7f2c7406f2e0 2023-10-06T03:53:45.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:45.266 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":24,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:43.999277+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 msgr2=0x7f2c54062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 0x7f2c54062a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c741404b0 tx=0x7f2c64009040 comp rx=0 tx=0).stop 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 msgr2=0x7f2c7414ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c5c0 tx=0x7f2c6800c980 comp rx=0 tx=0).stop 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 shutdown_connections 2023-10-06T03:53:45.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2c54060550 0x7f2c54062a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c740add20 0x7f2c740a5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c740a7df0 0x7f2c740a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 --2- 172.21.15.57:0/692964024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c7406f2e0 0x7f2c7414ff80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 >> 172.21.15.57:0/692964024 conn(0x7f2c74067070 msgr2=0x7f2c740b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 shutdown_connections 2023-10-06T03:53:45.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.263+0000 7f2c7359e700 1 -- 172.21.15.57:0/692964024 wait complete. 2023-10-06T03:53:45.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:53:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.387+0000 7f2cebfff700 1 Processor -- start 2023-10-06T03:53:45.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.387+0000 7f2cebfff700 1 -- start start 2023-10-06T03:53:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cec06e820 0x7f2cec0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec06dc50 con 0x7f2cec06e450 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec13e9c0 con 0x7f2cec0b0ba0 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec13eca0 con 0x7f2cec06e820 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cec06e820 0x7f2cec0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cec06e820 0x7f2cec0b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46706/0 (socket says 172.21.15.57:46706) 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 -- 172.21.15.57:0/2822483134 learned_addr learned my addr 172.21.15.57:0/2822483134 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ceaffd700 1 --1- 172.21.15.57:0/2822483134 >> v1:172.21.15.57:6789/0 conn(0x7f2cec06e450 0x7f2cec06c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49334/0 (socket says 172.21.15.57:49334) 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 -- 172.21.15.57:0/2822483134 >> v1:172.21.15.105:6789/0 conn(0x7f2cec0b0ba0 legacy=0x7f2cec0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 -- 172.21.15.57:0/2822483134 >> v1:172.21.15.57:6789/0 conn(0x7f2cec06e450 legacy=0x7f2cec06c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 -- 172.21.15.57:0/2822483134 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec13ef80 con 0x7f2cec06e820 2023-10-06T03:53:45.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2ce3fff700 1 --2- 172.21.15.57:0/2822483134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e820 0x7f2cec0b0660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40099b0 tx=0x7f2cd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3ff93613087e70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cea7fc700 1 -- 172.21.15.57:0/2822483134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400b860 con 0x7f2cec06e820 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cea7fc700 1 -- 172.21.15.57:0/2822483134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400b9c0 con 0x7f2cec06e820 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cea7fc700 1 -- 172.21.15.57:0/2822483134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400bd80 con 0x7f2cec06e820 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- 172.21.15.57:0/2822483134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e820 msgr2=0x7f2cec0b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 --2- 172.21.15.57:0/2822483134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e820 0x7f2cec0b0660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40099b0 tx=0x7f2cd4009250 comp rx=0 tx=0).stop 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- 172.21.15.57:0/2822483134 shutdown_connections 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 --2- 172.21.15.57:0/2822483134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e820 0x7f2cec0b0660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- 172.21.15.57:0/2822483134 >> 172.21.15.57:0/2822483134 conn(0x7f2cec0b1a90 msgr2=0x7f2cec0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- 172.21.15.57:0/2822483134 shutdown_connections 2023-10-06T03:53:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.391+0000 7f2cebfff700 1 -- 172.21.15.57:0/2822483134 wait complete. 2023-10-06T03:53:45.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 Processor -- start 2023-10-06T03:53:45.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- start start 2023-10-06T03:53:45.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cec06e820 0x7f2cec134df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cec0b0ba0 0x7f2cec141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec13f7c0 con 0x7f2cec06e450 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec136600 con 0x7f2cec06e820 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1368c0 con 0x7f2cec0b0ba0 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46712/0 (socket says 172.21.15.57:46712) 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 -- 172.21.15.57:0/3364848945 learned_addr learned my addr 172.21.15.57:0/3364848945 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ce3fff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cec06e820 0x7f2cec134df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceb7fe700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cec0b0ba0 0x7f2cec141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 -- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cec0b0ba0 msgr2=0x7f2cec141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cec0b0ba0 0x7f2cec141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 -- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cec06e820 msgr2=0x7f2cec134df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:45.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cec06e820 0x7f2cec134df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:45.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 -- 172.21.15.57:0/3364848945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40094f0 con 0x7f2cec06e450 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ceaffd700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c7c0 tx=0x7f2cdc007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0072e0 con 0x7f2cec06e450 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc007440 con 0x7f2cec06e450 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec140190 con 0x7f2cec06e450 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0057f0 con 0x7f2cec06e450 2023-10-06T03:53:45.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.395+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec1357e0 con 0x7f2cec06e450 2023-10-06T03:53:45.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.399+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec136a30 con 0x7f2cec06e450 2023-10-06T03:53:45.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.399+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2cdc005bc0 con 0x7f2cec06e450 2023-10-06T03:53:45.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.399+0000 7f2ce2ffd700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 0x7f2ccc064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:45.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.399+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cdc07bce0 con 0x7f2cec06e450 2023-10-06T03:53:45.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.399+0000 7f2ce3fff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 0x7f2ccc064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:45.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.403+0000 7f2ce3fff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 0x7f2ccc064c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cec06ec80 tx=0x7f2cd4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:45.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.407+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2cdc04c170 con 0x7f2cec06e450 2023-10-06T03:53:45.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:45.607+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2cec04b5c0 con 0x7f2cec06e450 2023-10-06T03:53:45.620 INFO:tasks.ceph.mds.b.smithi105.stderr:2023-10-06T03:53:45.617+0000 7f1341272700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:53:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.159+0000 7f2ce2ffd700 1 -- 172.21.15.57:0/3364848945 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2cdc04f790 con 0x7f2cec06e450 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.163+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 msgr2=0x7f2ccc064c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.163+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 0x7f2ccc064c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cec06ec80 tx=0x7f2cd4017000 comp rx=0 tx=0).stop 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.163+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 msgr2=0x7f2cec13fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.163+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c7c0 tx=0x7f2cdc007ea0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 shutdown_connections 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ccc062760 0x7f2ccc064c10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cec0b0ba0 0x7f2cec141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cec06e820 0x7f2cec134df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 --2- 172.21.15.57:0/3364848945 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cec06e450 0x7f2cec13fc50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 >> 172.21.15.57:0/3364848945 conn(0x7f2cec0b1a90 msgr2=0x7f2cec0b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 shutdown_connections 2023-10-06T03:53:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.167+0000 7f2cebfff700 1 -- 172.21.15.57:0/3364848945 wait complete. 2023-10-06T03:53:46.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:53:46.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.303+0000 7f74e72de700 1 Processor -- start 2023-10-06T03:53:46.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.303+0000 7f74e72de700 1 -- start start 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e72de700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74e006cc60 0x7f74e0138830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e72de700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e00b0c00 0x7f74e0138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e72de700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e006ddb0 con 0x7f74e006d670 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e72de700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e013f850 con 0x7f74e006cc60 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e72de700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e013fb30 con 0x7f74e00b0c00 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e62dc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f74e006d670 0x7f74e00b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49340/0 (socket says 172.21.15.57:49340) 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e62dc700 1 -- 172.21.15.57:0/3405990918 learned_addr learned my addr 172.21.15.57:0/3405990918 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:46.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e6add700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e00b0c00 0x7f74e0138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3405990918 >> v2:172.21.15.105:3300/0 conn(0x7f74e006cc60 0x7f74e0138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155743223 0 0) 0x7f74e006ddb0 con 0x7f74e006d670 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74cc003570 con 0x7f74e006d670 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 -- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e00b0c00 msgr2=0x7f74e0138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e00b0c00 0x7f74e0138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2912877856 0 0) 0x7f74cc003570 con 0x7f74e006d670 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 -- 172.21.15.57:0/3405990918 >> v1:172.21.15.57:6789/0 conn(0x7f74e006d670 legacy=0x7f74e00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 -- 172.21.15.57:0/3405990918 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e013fea0 con 0x7f74e006cc60 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e006cc60 0x7f74e0138830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74d00098e0 tx=0x7f74d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9e4aad63f92335 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:46.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc001470 con 0x7f74e006cc60 2023-10-06T03:53:46.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d0011420 con 0x7f74e006cc60 2023-10-06T03:53:46.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.307+0000 7f74e52da700 1 -- 172.21.15.57:0/3405990918 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d00117c0 con 0x7f74e006cc60 2023-10-06T03:53:46.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e006cc60 msgr2=0x7f74e0138830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e006cc60 0x7f74e0138830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74d00098e0 tx=0x7f74d00091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- 172.21.15.57:0/3405990918 shutdown_connections 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e00b0c00 0x7f74e0138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- 172.21.15.57:0/3405990918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e006cc60 0x7f74e0138830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- 172.21.15.57:0/3405990918 >> 172.21.15.57:0/3405990918 conn(0x7f74e0068180 msgr2=0x7f74e0068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- 172.21.15.57:0/3405990918 shutdown_connections 2023-10-06T03:53:46.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- 172.21.15.57:0/3405990918 wait complete. 2023-10-06T03:53:46.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 Processor -- start 2023-10-06T03:53:46.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- start start 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e006cc60 0x7f74e0140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e00b0c00 0x7f74e014f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b5000 con 0x7f74e006d670 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00af980 con 0x7f74e00b0c00 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e72de700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e013cca0 con 0x7f74e006cc60 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46722/0 (socket says 172.21.15.57:46722) 2023-10-06T03:53:46.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 -- 172.21.15.57:0/3172985160 learned_addr learned my addr 172.21.15.57:0/3172985160 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e62dc700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e006cc60 0x7f74e0140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e6add700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e00b0c00 0x7f74e014f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 -- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e006cc60 msgr2=0x7f74e0140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e006cc60 0x7f74e0140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 -- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e00b0c00 msgr2=0x7f74e014f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e00b0c00 0x7f74e014f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.311+0000 7f74e5adb700 1 -- 172.21.15.57:0/3172985160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d0009420 con 0x7f74e006d670 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74e5adb700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74d00030c0 tx=0x7f74d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d001cb30 con 0x7f74e006d670 2023-10-06T03:53:46.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d001cc90 con 0x7f74e006d670 2023-10-06T03:53:46.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e00b4d20 con 0x7f74e006d670 2023-10-06T03:53:46.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d001a6a0 con 0x7f74e006d670 2023-10-06T03:53:46.320 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e014f0f0 con 0x7f74e006d670 2023-10-06T03:53:46.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e00b2540 con 0x7f74e006d670 2023-10-06T03:53:46.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f74d001aad0 con 0x7f74e006d670 2023-10-06T03:53:46.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 0x7f74c4062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:46.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.315+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74d007e110 con 0x7f74e006d670 2023-10-06T03:53:46.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.319+0000 7f74e62dc700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 0x7f74c4062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:46.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.319+0000 7f74e62dc700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 0x7f74c4062a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74dc001ed0 tx=0x7f74dc0019d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:46.331 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.327+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f74e00b2540 con 0x7f74e006d670 2023-10-06T03:53:46.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:46.519+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f74e00b0110 con 0x7f74e006d670 2023-10-06T03:53:47.178 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.175+0000 7f74d67fc700 1 -- 172.21.15.57:0/3172985160 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74e00b0110 con 0x7f74e006d670 2023-10-06T03:53:47.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 msgr2=0x7f74c4062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 0x7f74c4062a30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74dc001ed0 tx=0x7f74dc0019d0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 msgr2=0x7f74e0152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74d00030c0 tx=0x7f74d0016000 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 shutdown_connections 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f74c4060580 0x7f74c4062a30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e00b0c00 0x7f74e014f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74e006d670 0x7f74e0152db0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 --2- 172.21.15.57:0/3172985160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e006cc60 0x7f74e0140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 >> 172.21.15.57:0/3172985160 conn(0x7f74e0068180 msgr2=0x7f74e013ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 shutdown_connections 2023-10-06T03:53:47.184 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.179+0000 7f74e72de700 1 -- 172.21.15.57:0/3172985160 wait complete. 2023-10-06T03:53:47.199 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:53:47.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 Processor -- start 2023-10-06T03:53:47.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 -- start start 2023-10-06T03:53:47.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 0x7f5264142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52640b0d00 0x7f52640b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52640b44a0 con 0x7f5264145910 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526413cad0 con 0x7f52640b0d00 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5268b54700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640b20e0 con 0x7f52640b0930 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5263fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5264145910 0x7f5264145d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49344/0 (socket says 172.21.15.57:49344) 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5263fff700 1 -- 172.21.15.57:0/4270271864 learned_addr learned my addr 172.21.15.57:0/4270271864 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:47.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52637fe700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 0x7f5264142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 --2- 172.21.15.57:0/4270271864 >> v2:172.21.15.105:3300/0 conn(0x7f52640b0d00 0x7f52640b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838608759 0 0) 0x7f52640b44a0 con 0x7f5264145910 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5250003570 con 0x7f5264145910 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 -- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 msgr2=0x7f5264142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 0x7f5264142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 -- 172.21.15.57:0/4270271864 >> v1:172.21.15.57:6789/0 conn(0x7f5264145910 legacy=0x7f5264145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578929139 0 0) 0x7f5250003570 con 0x7f5264145910 2023-10-06T03:53:47.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 -- 172.21.15.57:0/4270271864 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5264142310 con 0x7f52640b0d00 2023-10-06T03:53:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52637fe700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 0x7f5264142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f5262ffd700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0d00 0x7f52640b27e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f52540098e0 tx=0x7f52540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ca0b444a2b4e0f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c0017f0 con 0x7f52640b0d00 2023-10-06T03:53:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254011420 con 0x7f52640b0d00 2023-10-06T03:53:47.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.303+0000 7f52627fc700 1 -- 172.21.15.57:0/4270271864 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52540117a0 con 0x7f52640b0d00 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0d00 msgr2=0x7f52640b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0d00 0x7f52640b27e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f52540098e0 tx=0x7f52540091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- 172.21.15.57:0/4270271864 shutdown_connections 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0d00 0x7f52640b27e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 --2- 172.21.15.57:0/4270271864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0930 0x7f5264142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- 172.21.15.57:0/4270271864 >> 172.21.15.57:0/4270271864 conn(0x7f5264068f20 msgr2=0x7f5264069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- 172.21.15.57:0/4270271864 shutdown_connections 2023-10-06T03:53:47.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- 172.21.15.57:0/4270271864 wait complete. 2023-10-06T03:53:47.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 Processor -- start 2023-10-06T03:53:47.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.307+0000 7f5268b54700 1 -- start start 2023-10-06T03:53:47.316 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0930 0x7f526413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0d00 0x7f5264155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5264152270 con 0x7f5264145910 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526413f7f0 con 0x7f52640b0930 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52641524f0 con 0x7f52640b0d00 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46732/0 (socket says 172.21.15.57:46732) 2023-10-06T03:53:47.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 -- 172.21.15.57:0/2987770693 learned_addr learned my addr 172.21.15.57:0/2987770693 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5262ffd700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0d00 0x7f5264155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f52637fe700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0930 0x7f526413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 -- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0d00 msgr2=0x7f5264155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0d00 0x7f5264155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 -- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0930 msgr2=0x7f526413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.318 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0930 0x7f526413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 -- 172.21.15.57:0/2987770693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c009420 con 0x7f5264145910 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5263fff700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f525c00cc20 tx=0x7f525c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c004dc0 con 0x7f5264145910 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00a6a0 con 0x7f5264145910 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00aa60 con 0x7f5264145910 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5254009420 con 0x7f5264145910 2023-10-06T03:53:47.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.311+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5264152ab0 con 0x7f5264145910 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5264152ca0 con 0x7f5264145910 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f525c007150 con 0x7f5264145910 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f525b7fe700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 0x7f5244062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f525c07bf70 con 0x7f5264145910 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f52637fe700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 0x7f5244062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.315+0000 7f52637fe700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 0x7f5244062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f524c009ea0 tx=0x7f524c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.329 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.323+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f525c04c480 con 0x7f5264145910 2023-10-06T03:53:47.528 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.523+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52640b6340 con 0x7f5264145910 2023-10-06T03:53:47.529 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.523+0000 7f525b7fe700 1 -- 172.21.15.57:0/2987770693 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f525c018020 con 0x7f5264145910 2023-10-06T03:53:47.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:47.529 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:53:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 msgr2=0x7f5244062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.531 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 0x7f5244062a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f524c009ea0 tx=0x7f524c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 msgr2=0x7f52640ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f525c00cc20 tx=0x7f525c0015b0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 shutdown_connections 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5244060550 0x7f5244062a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5264145910 0x7f52640ae5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52640b0d00 0x7f5264155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 --2- 172.21.15.57:0/2987770693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52640b0930 0x7f526413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 >> 172.21.15.57:0/2987770693 conn(0x7f5264068f20 msgr2=0x7f52640b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 shutdown_connections 2023-10-06T03:53:47.532 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.527+0000 7f5268b54700 1 -- 172.21.15.57:0/2987770693 wait complete. 2023-10-06T03:53:47.533 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:53:47.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:47.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.643+0000 7f3debfff700 1 Processor -- start 2023-10-06T03:53:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.643+0000 7f3debfff700 1 -- start start 2023-10-06T03:53:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3dec06f2e0 0x7f3dec0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec143f30 con 0x7f3dec0a7df0 2023-10-06T03:53:47.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec0a9410 con 0x7f3dec0add20 2023-10-06T03:53:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0a9230 con 0x7f3dec06f2e0 2023-10-06T03:53:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3dea7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3dec0a7df0 0x7f3dec06ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49356/0 (socket says 172.21.15.57:49356) 2023-10-06T03:53:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3deb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3dec06f2e0 0x7f3dec0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3dea7fc700 1 -- 172.21.15.57:0/1226828882 learned_addr learned my addr 172.21.15.57:0/1226828882 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:47.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3deb7fe700 1 -- 172.21.15.57:0/1226828882 >> v1:172.21.15.105:6789/0 conn(0x7f3dec0add20 legacy=0x7f3dec13ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3deb7fe700 1 -- 172.21.15.57:0/1226828882 >> v1:172.21.15.57:6789/0 conn(0x7f3dec0a7df0 legacy=0x7f3dec06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3deb7fe700 1 -- 172.21.15.57:0/1226828882 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec1443c0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3deb7fe700 1 --2- 172.21.15.57:0/1226828882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec0aa920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009e60 tx=0x7f3de4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ca6c6117fc61cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3de9ffb700 1 -- 172.21.15.57:0/1226828882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400e070 con 0x7f3dec06f2e0 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3de9ffb700 1 -- 172.21.15.57:0/1226828882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400bc30 con 0x7f3dec06f2e0 2023-10-06T03:53:47.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3de9ffb700 1 -- 172.21.15.57:0/1226828882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4012430 con 0x7f3dec06f2e0 2023-10-06T03:53:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- 172.21.15.57:0/1226828882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 msgr2=0x7f3dec0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 --2- 172.21.15.57:0/1226828882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec0aa920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009e60 tx=0x7f3de4009780 comp rx=0 tx=0).stop 2023-10-06T03:53:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- 172.21.15.57:0/1226828882 shutdown_connections 2023-10-06T03:53:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 --2- 172.21.15.57:0/1226828882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec0aa920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- 172.21.15.57:0/1226828882 >> 172.21.15.57:0/1226828882 conn(0x7f3dec067070 msgr2=0x7f3dec067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- 172.21.15.57:0/1226828882 shutdown_connections 2023-10-06T03:53:47.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.647+0000 7f3debfff700 1 -- 172.21.15.57:0/1226828882 wait complete. 2023-10-06T03:53:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 Processor -- start 2023-10-06T03:53:47.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- start start 2023-10-06T03:53:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 0x7f3dec141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3dec0add20 0x7f3dec0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1439e0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec14fb70 con 0x7f3dec0a7df0 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec143320 con 0x7f3dec0add20 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46760/0 (socket says 172.21.15.57:46760) 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 -- 172.21.15.57:0/2470834037 learned_addr learned my addr 172.21.15.57:0/2470834037 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deb7fe700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3dec0add20 0x7f3dec0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3dea7fc700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 0x7f3dec141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 -- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3dec0add20 msgr2=0x7f3dec0a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3dec0add20 0x7f3dec0a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 -- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 msgr2=0x7f3dec141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 0x7f3dec141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 -- 172.21.15.57:0/2470834037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009a20 con 0x7f3dec06f2e0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3dea7fc700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 0x7f3dec141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3deaffd700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c7c0 tx=0x7f3de0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011590 con 0x7f3dec06f2e0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de0011710 con 0x7f3dec06f2e0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec06dde0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0011ad0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.651+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec1415b0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.655+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec14fe90 con 0x7f3dec06f2e0 2023-10-06T03:53:47.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.655+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3de001b3b0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.655+0000 7f3dd2ffd700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 0x7f3dd8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.659+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3de007c1c0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.659+0000 7f3dea7fc700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 0x7f3dd8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.659+0000 7f3dea7fc700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 0x7f3dd8062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dec06dd10 tx=0x7f3ddc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.659+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3de004c6d0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.824 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.819+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dec143bc0 con 0x7f3dec06f2e0 2023-10-06T03:53:47.826 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.823+0000 7f3dd2ffd700 1 -- 172.21.15.57:0/2470834037 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f3de0017020 con 0x7f3dec06f2e0 2023-10-06T03:53:47.827 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:47.827 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 msgr2=0x7f3dd8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 0x7f3dd8062a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3dec06dd10 tx=0x7f3ddc009040 comp rx=0 tx=0).stop 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 msgr2=0x7f3dec142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3de000c7c0 tx=0x7f3de0007f40 comp rx=0 tx=0).stop 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 shutdown_connections 2023-10-06T03:53:47.830 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3dd8060580 0x7f3dd8062a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3dec0add20 0x7f3dec0a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dec0a7df0 0x7f3dec141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 --2- 172.21.15.57:0/2470834037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3dec06f2e0 0x7f3dec142de0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 >> 172.21.15.57:0/2470834037 conn(0x7f3dec067070 msgr2=0x7f3dec0aa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 shutdown_connections 2023-10-06T03:53:47.831 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.827+0000 7f3debfff700 1 -- 172.21.15.57:0/2470834037 wait complete. 2023-10-06T03:53:47.841 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:53:47.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:53:47.948 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.943+0000 7f39d0b6b700 1 Processor -- start 2023-10-06T03:53:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.943+0000 7f39d0b6b700 1 -- start start 2023-10-06T03:53:47.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.943+0000 7f39d0b6b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39cc0b05f0 0x7f39cc0abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0ae9a0 con 0x7f39cc0ad480 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0afec0 con 0x7f39cc0b1530 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0ae140 con 0x7f39cc0b05f0 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39caffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f39cc0ad480 0x7f39cc0af0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49364/0 (socket says 172.21.15.57:49364) 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39caffd700 1 -- 172.21.15.57:0/494414096 learned_addr learned my addr 172.21.15.57:0/494414096 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410267236 0 0) 0x7f39cc0ae9a0 con 0x7f39cc0ad480 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/494414096 >> v2:172.21.15.105:3300/0 conn(0x7f39cc0b05f0 0x7f39cc0abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b4003570 con 0x7f39cc0ad480 2023-10-06T03:53:47.952 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029114190 0 0) 0x7f39cc0afec0 con 0x7f39cc0b1530 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc0ae9a0 con 0x7f39cc0b1530 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863027653 0 0) 0x7f39b4003570 con 0x7f39cc0ad480 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 >> v2:172.21.15.105:3300/0 conn(0x7f39cc0b05f0 msgr2=0x7f39cc0abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 --2- 172.21.15.57:0/494414096 >> v2:172.21.15.105:3300/0 conn(0x7f39cc0b05f0 0x7f39cc0abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 >> v1:172.21.15.105:6789/0 conn(0x7f39cc0b1530 legacy=0x7f39cc0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0ad9d0 con 0x7f39cc0ad480 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f39bc0017f0 con 0x7f39cc0ad480 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 >> v1:172.21.15.57:6789/0 conn(0x7f39cc0ad480 legacy=0x7f39cc0af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 0x7f39b4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.953 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4004810 0x7f39b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40051c0 0x7f39b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0ae140 con 0x7f39b4003bf0 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b400c0b0 con 0x7f39b4004810 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b400c270 con 0x7f39b40051c0 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 0x7f39b4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39caffd700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4004810 0x7f39b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 -- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40051c0 msgr2=0x7f39b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cbfff700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40051c0 0x7f39b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b40051c0 0x7f39b400ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 -- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4004810 msgr2=0x7f39b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:47.954 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4004810 0x7f39b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cbfff700 1 -- 172.21.15.57:0/494414096 reap_dead start 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 -- 172.21.15.57:0/494414096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4003570 con 0x7f39b4003bf0 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39caffd700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4004810 0x7f39b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 0x7f39b4003fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009c00 tx=0x7f39c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa1ce54ff5b808a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000e710 con 0x7f39b4003bf0 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000e870 con 0x7f39b4003bf0 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39ca7fc700 1 -- 172.21.15.57:0/494414096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000ec30 con 0x7f39b4003bf0 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 msgr2=0x7f39b4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 0x7f39b4003fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009c00 tx=0x7f39c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- 172.21.15.57:0/494414096 shutdown_connections 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/494414096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39b4003bf0 0x7f39b4003fe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.955 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- 172.21.15.57:0/494414096 >> 172.21.15.57:0/494414096 conn(0x7f39cc067070 msgr2=0x7f39cc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- 172.21.15.57:0/494414096 shutdown_connections 2023-10-06T03:53:47.956 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.947+0000 7f39d0b6b700 1 -- 172.21.15.57:0/494414096 wait complete. 2023-10-06T03:53:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 Processor -- start 2023-10-06T03:53:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 -- start start 2023-10-06T03:53:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4003bf0 0x7f39cc0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39cc11c850 0x7f39cc159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc11dea0 con 0x7f39cc15a530 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc156330 con 0x7f39b4003bf0 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39d0b6b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc11ce00 con 0x7f39cc11c850 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46774/0 (socket says 172.21.15.57:46774) 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39cbfff700 1 -- 172.21.15.57:0/1037184997 learned_addr learned my addr 172.21.15.57:0/1037184997 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39caffd700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39cc11c850 0x7f39cc159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.951+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4003bf0 0x7f39cc0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 -- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39cc11c850 msgr2=0x7f39cc159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39cc11c850 0x7f39cc159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 -- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4003bf0 msgr2=0x7f39cc0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4003bf0 0x7f39cc0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 -- 172.21.15.57:0/1037184997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc159ad0 con 0x7f39cc15a530 2023-10-06T03:53:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cbfff700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ab330 tx=0x7f39c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400b070 con 0x7f39cc15a530 2023-10-06T03:53:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400de40 con 0x7f39cc15a530 2023-10-06T03:53:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc120510 con 0x7f39cc15a530 2023-10-06T03:53:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40117b0 con 0x7f39cc15a530 2023-10-06T03:53:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc06cfd0 con 0x7f39cc15a530 2023-10-06T03:53:47.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc159930 con 0x7f39cc15a530 2023-10-06T03:53:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f39c4011be0 con 0x7f39cc15a530 2023-10-06T03:53:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 0x7f39b8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39c407c600 con 0x7f39cc15a530 2023-10-06T03:53:47.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.955+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 0x7f39b8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:47.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.959+0000 7f39cb7fe700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 0x7f39b8062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39c00091e0 tx=0x7f39c001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:47.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:47.963+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f39cc159930 con 0x7f39cc15a530 2023-10-06T03:53:48.127 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.123+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39cc159d10 con 0x7f39b8060550 2023-10-06T03:53:48.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.143+0000 7f39b37fe700 1 -- 172.21.15.57:0/1037184997 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286558 (secure 0 0 0) 0x7f39cc159d10 con 0x7f39b8060550 2023-10-06T03:53:48.149 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 msgr2=0x7f39b8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 0x7f39b8062a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f39c00091e0 tx=0x7f39c001a000 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 msgr2=0x7f39cc156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ab330 tx=0x7f39c4009040 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 shutdown_connections 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f39b8060550 0x7f39b8062a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39cc15a530 0x7f39cc156760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39cc11c850 0x7f39cc159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 --2- 172.21.15.57:0/1037184997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b4003bf0 0x7f39cc0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 >> 172.21.15.57:0/1037184997 conn(0x7f39cc067070 msgr2=0x7f39cc14c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:48.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 shutdown_connections 2023-10-06T03:53:48.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.147+0000 7f39d0b6b700 1 -- 172.21.15.57:0/1037184997 wait complete. 2023-10-06T03:53:48.153 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:53:48.168 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T03:53:46.624106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397888,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576832,"statfs":{"total":773094113280,"available":770638675968,"internally_reserved":0,"allocated":3276800,"data_stored":1923590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667295+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:53:44.667295+0000","last_peered":"2023-10-06T03:53:44.667295+0000","last_clean":"2023-10-06T03:53:44.667295+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:53:44.667295+0000","last_undegraded":"2023-10-06T03:53:44.667295+0000","last_fullsized":"2023-10-06T03:53:44.667295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665648+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:53:44.665648+0000","last_peered":"2023-10-06T03:53:44.665648+0000","last_clean":"2023-10-06T03:53:44.665648+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:53:44.665648+0000","last_undegraded":"2023-10-06T03:53:44.665648+0000","last_fullsized":"2023-10-06T03:53:44.665648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669768+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:53:44.669768+0000","last_peered":"2023-10-06T03:53:44.669768+0000","last_clean":"2023-10-06T03:53:44.669768+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:53:44.669768+0000","last_undegraded":"2023-10-06T03:53:44.669768+0000","last_fullsized":"2023-10-06T03:53:44.669768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662122+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:53:44.662122+0000","last_peered":"2023-10-06T03:53:44.662122+0000","last_clean":"2023-10-06T03:53:44.662122+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:53:44.662122+0000","last_undegraded":"2023-10-06T03:53:44.662122+0000","last_fullsized":"2023-10-06T03:53:44.662122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659209+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:53:44.659209+0000","last_peered":"2023-10-06T03:53:44.659209+0000","last_clean":"2023-10-06T03:53:44.659209+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:53:44.659209+0000","last_undegraded":"2023-10-06T03:53:44.659209+0000","last_fullsized":"2023-10-06T03:53:44.659209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667704+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:53:44.667704+0000","last_peered":"2023-10-06T03:53:44.667704+0000","last_clean":"2023-10-06T03:53:44.667704+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:53:44.667704+0000","last_undegraded":"2023-10-06T03:53:44.667704+0000","last_fullsized":"2023-10-06T03:53:44.667704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662491+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:53:44.662491+0000","last_peered":"2023-10-06T03:53:44.662491+0000","last_clean":"2023-10-06T03:53:44.662491+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:53:44.662491+0000","last_undegraded":"2023-10-06T03:53:44.662491+0000","last_fullsized":"2023-10-06T03:53:44.662491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655682+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:53:44.655682+0000","last_peered":"2023-10-06T03:53:44.655682+0000","last_clean":"2023-10-06T03:53:44.655682+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:53:44.655682+0000","last_undegraded":"2023-10-06T03:53:44.655682+0000","last_fullsized":"2023-10-06T03:53:44.655682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668756+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:53:44.668756+0000","last_peered":"2023-10-06T03:53:44.668756+0000","last_clean":"2023-10-06T03:53:44.668756+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:53:44.668756+0000","last_undegraded":"2023-10-06T03:53:44.668756+0000","last_fullsized":"2023-10-06T03:53:44.668756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668983+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:53:44.668983+0000","last_peered":"2023-10-06T03:53:44.668983+0000","last_clean":"2023-10-06T03:53:44.668983+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:53:44.668983+0000","last_undegraded":"2023-10-06T03:53:44.668983+0000","last_fullsized":"2023-10-06T03:53:44.668983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668016+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:53:44.668016+0000","last_peered":"2023-10-06T03:53:44.668016+0000","last_clean":"2023-10-06T03:53:44.668016+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:53:44.668016+0000","last_undegraded":"2023-10-06T03:53:44.668016+0000","last_fullsized":"2023-10-06T03:53:44.668016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672653+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:53:44.672653+0000","last_peered":"2023-10-06T03:53:44.672653+0000","last_clean":"2023-10-06T03:53:44.672653+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:53:44.672653+0000","last_undegraded":"2023-10-06T03:53:44.672653+0000","last_fullsized":"2023-10-06T03:53:44.672653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672575+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:53:44.672575+0000","last_peered":"2023-10-06T03:53:44.672575+0000","last_clean":"2023-10-06T03:53:44.672575+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:53:44.672575+0000","last_undegraded":"2023-10-06T03:53:44.672575+0000","last_fullsized":"2023-10-06T03:53:44.672575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664859+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:53:44.664859+0000","last_peered":"2023-10-06T03:53:44.664859+0000","last_clean":"2023-10-06T03:53:44.664859+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:53:44.664859+0000","last_undegraded":"2023-10-06T03:53:44.664859+0000","last_fullsized":"2023-10-06T03:53:44.664859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662631+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:53:44.662631+0000","last_peered":"2023-10-06T03:53:44.662631+0000","last_clean":"2023-10-06T03:53:44.662631+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:53:44.662631+0000","last_undegraded":"2023-10-06T03:53:44.662631+0000","last_fullsized":"2023-10-06T03:53:44.662631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667627+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:53:44.667627+0000","last_peered":"2023-10-06T03:53:44.667627+0000","last_clean":"2023-10-06T03:53:44.667627+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:53:44.667627+0000","last_undegraded":"2023-10-06T03:53:44.667627+0000","last_fullsized":"2023-10-06T03:53:44.667627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668966+0000","last_change":"2023-10-06T03:53:44.668966+0000","last_active":"2023-10-06T03:53:44.668966+0000","last_peered":"2023-10-06T03:53:44.668966+0000","last_clean":"2023-10-06T03:53:44.668966+0000","last_became_active":"2023-10-06T03:53:44.668702+0000","last_became_peered":"2023-10-06T03:53:44.668702+0000","last_unstale":"2023-10-06T03:53:44.668966+0000","last_undegraded":"2023-10-06T03:53:44.668966+0000","last_fullsized":"2023-10-06T03:53:44.668966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669820+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:53:44.669820+0000","last_peered":"2023-10-06T03:53:44.669820+0000","last_clean":"2023-10-06T03:53:44.669820+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:53:44.669820+0000","last_undegraded":"2023-10-06T03:53:44.669820+0000","last_fullsized":"2023-10-06T03:53:44.669820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.677385+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:53:44.677385+0000","last_peered":"2023-10-06T03:53:44.677385+0000","last_clean":"2023-10-06T03:53:44.677385+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:53:44.677385+0000","last_undegraded":"2023-10-06T03:53:44.677385+0000","last_fullsized":"2023-10-06T03:53:44.677385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668754+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:53:44.668754+0000","last_peered":"2023-10-06T03:53:44.668754+0000","last_clean":"2023-10-06T03:53:44.668754+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:53:44.668754+0000","last_undegraded":"2023-10-06T03:53:44.668754+0000","last_fullsized":"2023-10-06T03:53:44.668754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673407+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:53:44.673407+0000","last_peered":"2023-10-06T03:53:44.673407+0000","last_clean":"2023-10-06T03:53:44.673407+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:53:44.673407+0000","last_undegraded":"2023-10-06T03:53:44.673407+0000","last_fullsized":"2023-10-06T03:53:44.673407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662003+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:53:44.662003+0000","last_peered":"2023-10-06T03:53:44.662003+0000","last_clean":"2023-10-06T03:53:44.662003+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:53:44.662003+0000","last_undegraded":"2023-10-06T03:53:44.662003+0000","last_fullsized":"2023-10-06T03:53:44.662003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673046+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:53:44.673046+0000","last_peered":"2023-10-06T03:53:44.673046+0000","last_clean":"2023-10-06T03:53:44.673046+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:53:44.673046+0000","last_undegraded":"2023-10-06T03:53:44.673046+0000","last_fullsized":"2023-10-06T03:53:44.673046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661181+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:53:44.661181+0000","last_peered":"2023-10-06T03:53:44.661181+0000","last_clean":"2023-10-06T03:53:44.661181+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:53:44.661181+0000","last_undegraded":"2023-10-06T03:53:44.661181+0000","last_fullsized":"2023-10-06T03:53:44.661181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672616+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:53:44.672616+0000","last_peered":"2023-10-06T03:53:44.672616+0000","last_clean":"2023-10-06T03:53:44.672616+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:53:44.672616+0000","last_undegraded":"2023-10-06T03:53:44.672616+0000","last_fullsized":"2023-10-06T03:53:44.672616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671192+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:53:44.671192+0000","last_peered":"2023-10-06T03:53:44.671192+0000","last_clean":"2023-10-06T03:53:44.671192+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:53:44.671192+0000","last_undegraded":"2023-10-06T03:53:44.671192+0000","last_fullsized":"2023-10-06T03:53:44.671192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663576+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:53:44.663576+0000","last_peered":"2023-10-06T03:53:44.663576+0000","last_clean":"2023-10-06T03:53:44.663576+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:53:44.663576+0000","last_undegraded":"2023-10-06T03:53:44.663576+0000","last_fullsized":"2023-10-06T03:53:44.663576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660454+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:53:44.660454+0000","last_peered":"2023-10-06T03:53:44.660454+0000","last_clean":"2023-10-06T03:53:44.660454+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:53:44.660454+0000","last_undegraded":"2023-10-06T03:53:44.660454+0000","last_fullsized":"2023-10-06T03:53:44.660454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665103+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:53:44.665103+0000","last_peered":"2023-10-06T03:53:44.665103+0000","last_clean":"2023-10-06T03:53:44.665103+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:53:44.665103+0000","last_undegraded":"2023-10-06T03:53:44.665103+0000","last_fullsized":"2023-10-06T03:53:44.665103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670029+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:53:44.670029+0000","last_peered":"2023-10-06T03:53:44.670029+0000","last_clean":"2023-10-06T03:53:44.670029+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:53:44.670029+0000","last_undegraded":"2023-10-06T03:53:44.670029+0000","last_fullsized":"2023-10-06T03:53:44.670029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671536+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:53:44.671536+0000","last_peered":"2023-10-06T03:53:44.671536+0000","last_clean":"2023-10-06T03:53:44.671536+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:53:44.671536+0000","last_undegraded":"2023-10-06T03:53:44.671536+0000","last_fullsized":"2023-10-06T03:53:44.671536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664518+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:53:44.664518+0000","last_peered":"2023-10-06T03:53:44.664518+0000","last_clean":"2023-10-06T03:53:44.664518+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:53:44.664518+0000","last_undegraded":"2023-10-06T03:53:44.664518+0000","last_fullsized":"2023-10-06T03:53:44.664518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669851+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:53:44.669851+0000","last_peered":"2023-10-06T03:53:44.669851+0000","last_clean":"2023-10-06T03:53:44.669851+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:53:44.669851+0000","last_undegraded":"2023-10-06T03:53:44.669851+0000","last_fullsized":"2023-10-06T03:53:44.669851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668369+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:53:44.668369+0000","last_peered":"2023-10-06T03:53:44.668369+0000","last_clean":"2023-10-06T03:53:44.668369+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:53:44.668369+0000","last_undegraded":"2023-10-06T03:53:44.668369+0000","last_fullsized":"2023-10-06T03:53:44.668369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661057+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:53:44.661057+0000","last_peered":"2023-10-06T03:53:44.661057+0000","last_clean":"2023-10-06T03:53:44.661057+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:53:44.661057+0000","last_undegraded":"2023-10-06T03:53:44.661057+0000","last_fullsized":"2023-10-06T03:53:44.661057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666260+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:53:43.666260+0000","last_peered":"2023-10-06T03:53:43.666260+0000","last_clean":"2023-10-06T03:53:43.666260+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:53:43.666260+0000","last_undegraded":"2023-10-06T03:53:43.666260+0000","last_fullsized":"2023-10-06T03:53:43.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668434+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:53:44.668434+0000","last_peered":"2023-10-06T03:53:44.668434+0000","last_clean":"2023-10-06T03:53:44.668434+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:53:44.668434+0000","last_undegraded":"2023-10-06T03:53:44.668434+0000","last_fullsized":"2023-10-06T03:53:44.668434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.658248+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:53:43.658248+0000","last_peered":"2023-10-06T03:53:43.658248+0000","last_clean":"2023-10-06T03:53:43.658248+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:53:43.658248+0000","last_undegraded":"2023-10-06T03:53:43.658248+0000","last_fullsized":"2023-10-06T03:53:43.658248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663208+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:53:44.663208+0000","last_peered":"2023-10-06T03:53:44.663208+0000","last_clean":"2023-10-06T03:53:44.663208+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:53:44.663208+0000","last_undegraded":"2023-10-06T03:53:44.663208+0000","last_fullsized":"2023-10-06T03:53:44.663208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673188+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:53:44.673188+0000","last_peered":"2023-10-06T03:53:44.673188+0000","last_clean":"2023-10-06T03:53:44.673188+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:53:44.673188+0000","last_undegraded":"2023-10-06T03:53:44.673188+0000","last_fullsized":"2023-10-06T03:53:44.673188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.653551+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:53:44.653551+0000","last_peered":"2023-10-06T03:53:44.653551+0000","last_clean":"2023-10-06T03:53:44.653551+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:53:44.653551+0000","last_undegraded":"2023-10-06T03:53:44.653551+0000","last_fullsized":"2023-10-06T03:53:44.653551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659297+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:53:44.659297+0000","last_peered":"2023-10-06T03:53:44.659297+0000","last_clean":"2023-10-06T03:53:44.659297+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:53:44.659297+0000","last_undegraded":"2023-10-06T03:53:44.659297+0000","last_fullsized":"2023-10-06T03:53:44.659297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668137+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:53:44.668137+0000","last_peered":"2023-10-06T03:53:44.668137+0000","last_clean":"2023-10-06T03:53:44.668137+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:53:44.668137+0000","last_undegraded":"2023-10-06T03:53:44.668137+0000","last_fullsized":"2023-10-06T03:53:44.668137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670120+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:53:44.670120+0000","last_peered":"2023-10-06T03:53:44.670120+0000","last_clean":"2023-10-06T03:53:44.670120+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:53:44.670120+0000","last_undegraded":"2023-10-06T03:53:44.670120+0000","last_fullsized":"2023-10-06T03:53:44.670120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654020+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:53:44.654020+0000","last_peered":"2023-10-06T03:53:44.654020+0000","last_clean":"2023-10-06T03:53:44.654020+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:53:44.654020+0000","last_undegraded":"2023-10-06T03:53:44.654020+0000","last_fullsized":"2023-10-06T03:53:44.654020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663448+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:53:44.663448+0000","last_peered":"2023-10-06T03:53:44.663448+0000","last_clean":"2023-10-06T03:53:44.663448+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:53:44.663448+0000","last_undegraded":"2023-10-06T03:53:44.663448+0000","last_fullsized":"2023-10-06T03:53:44.663448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.668803+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:53:43.668803+0000","last_peered":"2023-10-06T03:53:43.668803+0000","last_clean":"2023-10-06T03:53:43.668803+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:53:43.668803+0000","last_undegraded":"2023-10-06T03:53:43.668803+0000","last_fullsized":"2023-10-06T03:53:43.668803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664065+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:53:44.664065+0000","last_peered":"2023-10-06T03:53:44.664065+0000","last_clean":"2023-10-06T03:53:44.664065+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:53:44.664065+0000","last_undegraded":"2023-10-06T03:53:44.664065+0000","last_fullsized":"2023-10-06T03:53:44.664065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671648+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:53:44.671648+0000","last_peered":"2023-10-06T03:53:44.671648+0000","last_clean":"2023-10-06T03:53:44.671648+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:53:44.671648+0000","last_undegraded":"2023-10-06T03:53:44.671648+0000","last_fullsized":"2023-10-06T03:53:44.671648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668734+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:53:44.668734+0000","last_peered":"2023-10-06T03:53:44.668734+0000","last_clean":"2023-10-06T03:53:44.668734+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:53:44.668734+0000","last_undegraded":"2023-10-06T03:53:44.668734+0000","last_fullsized":"2023-10-06T03:53:44.668734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.654591+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:53:43.654591+0000","last_peered":"2023-10-06T03:53:43.654591+0000","last_clean":"2023-10-06T03:53:43.654591+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:53:43.654591+0000","last_undegraded":"2023-10-06T03:53:43.654591+0000","last_fullsized":"2023-10-06T03:53:43.654591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669955+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:53:44.669955+0000","last_peered":"2023-10-06T03:53:44.669955+0000","last_clean":"2023-10-06T03:53:44.669955+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:53:44.669955+0000","last_undegraded":"2023-10-06T03:53:44.669955+0000","last_fullsized":"2023-10-06T03:53:44.669955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.638833+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:53:44.638833+0000","last_peered":"2023-10-06T03:53:44.638833+0000","last_clean":"2023-10-06T03:53:44.638833+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:53:44.638833+0000","last_undegraded":"2023-10-06T03:53:44.638833+0000","last_fullsized":"2023-10-06T03:53:44.638833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669986+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:53:44.669986+0000","last_peered":"2023-10-06T03:53:44.669986+0000","last_clean":"2023-10-06T03:53:44.669986+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:53:44.669986+0000","last_undegraded":"2023-10-06T03:53:44.669986+0000","last_fullsized":"2023-10-06T03:53:44.669986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.669212+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:53:43.669212+0000","last_peered":"2023-10-06T03:53:43.669212+0000","last_clean":"2023-10-06T03:53:43.669212+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:53:43.669212+0000","last_undegraded":"2023-10-06T03:53:43.669212+0000","last_fullsized":"2023-10-06T03:53:43.669212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670493+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:53:44.670493+0000","last_peered":"2023-10-06T03:53:44.670493+0000","last_clean":"2023-10-06T03:53:44.670493+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:53:44.670493+0000","last_undegraded":"2023-10-06T03:53:44.670493+0000","last_fullsized":"2023-10-06T03:53:44.670493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.649197+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:53:43.649197+0000","last_peered":"2023-10-06T03:53:43.649197+0000","last_clean":"2023-10-06T03:53:43.649197+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:53:43.649197+0000","last_undegraded":"2023-10-06T03:53:43.649197+0000","last_fullsized":"2023-10-06T03:53:43.649197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.645491+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:53:43.645491+0000","last_peered":"2023-10-06T03:53:43.645491+0000","last_clean":"2023-10-06T03:53:43.645491+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:53:43.645491+0000","last_undegraded":"2023-10-06T03:53:43.645491+0000","last_fullsized":"2023-10-06T03:53:43.645491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.670989+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:53:43.670989+0000","last_peered":"2023-10-06T03:53:43.670989+0000","last_clean":"2023-10-06T03:53:43.670989+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:53:43.670989+0000","last_undegraded":"2023-10-06T03:53:43.670989+0000","last_fullsized":"2023-10-06T03:53:43.670989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661889+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:53:44.661889+0000","last_peered":"2023-10-06T03:53:44.661889+0000","last_clean":"2023-10-06T03:53:44.661889+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:53:44.661889+0000","last_undegraded":"2023-10-06T03:53:44.661889+0000","last_fullsized":"2023-10-06T03:53:44.661889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.649151+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:53:43.649151+0000","last_peered":"2023-10-06T03:53:43.649151+0000","last_clean":"2023-10-06T03:53:43.649151+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:53:43.649151+0000","last_undegraded":"2023-10-06T03:53:43.649151+0000","last_fullsized":"2023-10-06T03:53:43.649151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666125+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:53:43.666125+0000","last_peered":"2023-10-06T03:53:43.666125+0000","last_clean":"2023-10-06T03:53:43.666125+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:53:43.666125+0000","last_undegraded":"2023-10-06T03:53:43.666125+0000","last_fullsized":"2023-10-06T03:53:43.666125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662895+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:53:44.662895+0000","last_peered":"2023-10-06T03:53:44.662895+0000","last_clean":"2023-10-06T03:53:44.662895+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:53:44.662895+0000","last_undegraded":"2023-10-06T03:53:44.662895+0000","last_fullsized":"2023-10-06T03:53:44.662895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652382+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:53:44.652382+0000","last_peered":"2023-10-06T03:53:44.652382+0000","last_clean":"2023-10-06T03:53:44.652382+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:53:44.652382+0000","last_undegraded":"2023-10-06T03:53:44.652382+0000","last_fullsized":"2023-10-06T03:53:44.652382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.660448+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:53:43.660448+0000","last_peered":"2023-10-06T03:53:43.660448+0000","last_clean":"2023-10-06T03:53:43.660448+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:53:43.660448+0000","last_undegraded":"2023-10-06T03:53:43.660448+0000","last_fullsized":"2023-10-06T03:53:43.660448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659941+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:53:44.659941+0000","last_peered":"2023-10-06T03:53:44.659941+0000","last_clean":"2023-10-06T03:53:44.659941+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:53:44.659941+0000","last_undegraded":"2023-10-06T03:53:44.659941+0000","last_fullsized":"2023-10-06T03:53:44.659941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.645913+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:53:43.645913+0000","last_peered":"2023-10-06T03:53:43.645913+0000","last_clean":"2023-10-06T03:53:43.645913+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:53:43.645913+0000","last_undegraded":"2023-10-06T03:53:43.645913+0000","last_fullsized":"2023-10-06T03:53:43.645913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641446+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:53:44.641446+0000","last_peered":"2023-10-06T03:53:44.641446+0000","last_clean":"2023-10-06T03:53:44.641446+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:53:44.641446+0000","last_undegraded":"2023-10-06T03:53:44.641446+0000","last_fullsized":"2023-10-06T03:53:44.641446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672856+0000","last_change":"2023-10-06T03:53:44.672856+0000","last_active":"2023-10-06T03:53:44.672856+0000","last_peered":"2023-10-06T03:53:44.672856+0000","last_clean":"2023-10-06T03:53:44.672856+0000","last_became_active":"2023-10-06T03:53:44.670507+0000","last_became_peered":"2023-10-06T03:53:44.670507+0000","last_unstale":"2023-10-06T03:53:44.672856+0000","last_undegraded":"2023-10-06T03:53:44.672856+0000","last_fullsized":"2023-10-06T03:53:44.672856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.668775+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:53:43.668775+0000","last_peered":"2023-10-06T03:53:43.668775+0000","last_clean":"2023-10-06T03:53:43.668775+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:53:43.668775+0000","last_undegraded":"2023-10-06T03:53:43.668775+0000","last_fullsized":"2023-10-06T03:53:43.668775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.647669+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:53:43.647669+0000","last_peered":"2023-10-06T03:53:43.647669+0000","last_clean":"2023-10-06T03:53:43.647669+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:53:43.647669+0000","last_undegraded":"2023-10-06T03:53:43.647669+0000","last_fullsized":"2023-10-06T03:53:43.647669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660124+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:53:44.660124+0000","last_peered":"2023-10-06T03:53:44.660124+0000","last_clean":"2023-10-06T03:53:44.660124+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:53:44.660124+0000","last_undegraded":"2023-10-06T03:53:44.660124+0000","last_fullsized":"2023-10-06T03:53:44.660124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.665902+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:53:43.665902+0000","last_peered":"2023-10-06T03:53:43.665902+0000","last_clean":"2023-10-06T03:53:43.665902+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:53:43.665902+0000","last_undegraded":"2023-10-06T03:53:43.665902+0000","last_fullsized":"2023-10-06T03:53:43.665902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.653348+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:53:43.653348+0000","last_peered":"2023-10-06T03:53:43.653348+0000","last_clean":"2023-10-06T03:53:43.653348+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:53:43.653348+0000","last_undegraded":"2023-10-06T03:53:43.653348+0000","last_fullsized":"2023-10-06T03:53:43.653348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663854+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:53:44.663854+0000","last_peered":"2023-10-06T03:53:44.663854+0000","last_clean":"2023-10-06T03:53:44.663854+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:53:44.663854+0000","last_undegraded":"2023-10-06T03:53:44.663854+0000","last_fullsized":"2023-10-06T03:53:44.663854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661990+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:53:44.661990+0000","last_peered":"2023-10-06T03:53:44.661990+0000","last_clean":"2023-10-06T03:53:44.661990+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:53:44.661990+0000","last_undegraded":"2023-10-06T03:53:44.661990+0000","last_fullsized":"2023-10-06T03:53:44.661990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.647522+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:53:43.647522+0000","last_peered":"2023-10-06T03:53:43.647522+0000","last_clean":"2023-10-06T03:53:43.647522+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:53:43.647522+0000","last_undegraded":"2023-10-06T03:53:43.647522+0000","last_fullsized":"2023-10-06T03:53:43.647522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661587+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:53:44.661587+0000","last_peered":"2023-10-06T03:53:44.661587+0000","last_clean":"2023-10-06T03:53:44.661587+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:53:44.661587+0000","last_undegraded":"2023-10-06T03:53:44.661587+0000","last_fullsized":"2023-10-06T03:53:44.661587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.671185+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:53:43.671185+0000","last_peered":"2023-10-06T03:53:43.671185+0000","last_clean":"2023-10-06T03:53:43.671185+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:53:43.671185+0000","last_undegraded":"2023-10-06T03:53:43.671185+0000","last_fullsized":"2023-10-06T03:53:43.671185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.642152+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:53:43.642152+0000","last_peered":"2023-10-06T03:53:43.642152+0000","last_clean":"2023-10-06T03:53:43.642152+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:53:43.642152+0000","last_undegraded":"2023-10-06T03:53:43.642152+0000","last_fullsized":"2023-10-06T03:53:43.642152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654585+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:53:44.654585+0000","last_peered":"2023-10-06T03:53:44.654585+0000","last_clean":"2023-10-06T03:53:44.654585+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:53:44.654585+0000","last_undegraded":"2023-10-06T03:53:44.654585+0000","last_fullsized":"2023-10-06T03:53:44.654585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668210+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:53:44.668210+0000","last_peered":"2023-10-06T03:53:44.668210+0000","last_clean":"2023-10-06T03:53:44.668210+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:53:44.668210+0000","last_undegraded":"2023-10-06T03:53:44.668210+0000","last_fullsized":"2023-10-06T03:53:44.668210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672268+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:53:44.672268+0000","last_peered":"2023-10-06T03:53:44.672268+0000","last_clean":"2023-10-06T03:53:44.672268+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:53:44.672268+0000","last_undegraded":"2023-10-06T03:53:44.672268+0000","last_fullsized":"2023-10-06T03:53:44.672268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672455+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:53:44.672455+0000","last_peered":"2023-10-06T03:53:44.672455+0000","last_clean":"2023-10-06T03:53:44.672455+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:53:44.672455+0000","last_undegraded":"2023-10-06T03:53:44.672455+0000","last_fullsized":"2023-10-06T03:53:44.672455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670554+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:53:44.670554+0000","last_peered":"2023-10-06T03:53:44.670554+0000","last_clean":"2023-10-06T03:53:44.670554+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:53:44.670554+0000","last_undegraded":"2023-10-06T03:53:44.670554+0000","last_fullsized":"2023-10-06T03:53:44.670554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.657592+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:53:43.657592+0000","last_peered":"2023-10-06T03:53:43.657592+0000","last_clean":"2023-10-06T03:53:43.657592+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:53:43.657592+0000","last_undegraded":"2023-10-06T03:53:43.657592+0000","last_fullsized":"2023-10-06T03:53:43.657592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664680+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:53:44.664680+0000","last_peered":"2023-10-06T03:53:44.664680+0000","last_clean":"2023-10-06T03:53:44.664680+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:53:44.664680+0000","last_undegraded":"2023-10-06T03:53:44.664680+0000","last_fullsized":"2023-10-06T03:53:44.664680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666255+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:53:43.666255+0000","last_peered":"2023-10-06T03:53:43.666255+0000","last_clean":"2023-10-06T03:53:43.666255+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:53:43.666255+0000","last_undegraded":"2023-10-06T03:53:43.666255+0000","last_fullsized":"2023-10-06T03:53:43.666255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669613+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:53:44.669613+0000","last_peered":"2023-10-06T03:53:44.669613+0000","last_clean":"2023-10-06T03:53:44.669613+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:53:44.669613+0000","last_undegraded":"2023-10-06T03:53:44.669613+0000","last_fullsized":"2023-10-06T03:53:44.669613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661979+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:53:44.661979+0000","last_peered":"2023-10-06T03:53:44.661979+0000","last_clean":"2023-10-06T03:53:44.661979+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:53:44.661979+0000","last_undegraded":"2023-10-06T03:53:44.661979+0000","last_fullsized":"2023-10-06T03:53:44.661979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.676262+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:53:43.676262+0000","last_peered":"2023-10-06T03:53:43.676262+0000","last_clean":"2023-10-06T03:53:43.676262+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:53:43.676262+0000","last_undegraded":"2023-10-06T03:53:43.676262+0000","last_fullsized":"2023-10-06T03:53:43.676262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663603+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:53:44.663603+0000","last_peered":"2023-10-06T03:53:44.663603+0000","last_clean":"2023-10-06T03:53:44.663603+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:53:44.663603+0000","last_undegraded":"2023-10-06T03:53:44.663603+0000","last_fullsized":"2023-10-06T03:53:44.663603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.671499+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:53:43.671499+0000","last_peered":"2023-10-06T03:53:43.671499+0000","last_clean":"2023-10-06T03:53:43.671499+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:53:43.671499+0000","last_undegraded":"2023-10-06T03:53:43.671499+0000","last_fullsized":"2023-10-06T03:53:43.671499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661346+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:53:44.661346+0000","last_peered":"2023-10-06T03:53:44.661346+0000","last_clean":"2023-10-06T03:53:44.661346+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:53:44.661346+0000","last_undegraded":"2023-10-06T03:53:44.661346+0000","last_fullsized":"2023-10-06T03:53:44.661346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660417+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:53:44.660417+0000","last_peered":"2023-10-06T03:53:44.660417+0000","last_clean":"2023-10-06T03:53:44.660417+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:53:44.660417+0000","last_undegraded":"2023-10-06T03:53:44.660417+0000","last_fullsized":"2023-10-06T03:53:44.660417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672673+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:53:44.672673+0000","last_peered":"2023-10-06T03:53:44.672673+0000","last_clean":"2023-10-06T03:53:44.672673+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:53:44.672673+0000","last_undegraded":"2023-10-06T03:53:44.672673+0000","last_fullsized":"2023-10-06T03:53:44.672673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652882+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:53:44.652882+0000","last_peered":"2023-10-06T03:53:44.652882+0000","last_clean":"2023-10-06T03:53:44.652882+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:53:44.652882+0000","last_undegraded":"2023-10-06T03:53:44.652882+0000","last_fullsized":"2023-10-06T03:53:44.652882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667758+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:53:44.667758+0000","last_peered":"2023-10-06T03:53:44.667758+0000","last_clean":"2023-10-06T03:53:44.667758+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:53:44.667758+0000","last_undegraded":"2023-10-06T03:53:44.667758+0000","last_fullsized":"2023-10-06T03:53:44.667758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655032+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:53:44.655032+0000","last_peered":"2023-10-06T03:53:44.655032+0000","last_clean":"2023-10-06T03:53:44.655032+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:53:44.655032+0000","last_undegraded":"2023-10-06T03:53:44.655032+0000","last_fullsized":"2023-10-06T03:53:44.655032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667741+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:53:44.667741+0000","last_peered":"2023-10-06T03:53:44.667741+0000","last_clean":"2023-10-06T03:53:44.667741+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:53:44.667741+0000","last_undegraded":"2023-10-06T03:53:44.667741+0000","last_fullsized":"2023-10-06T03:53:44.667741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655090+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:53:44.655090+0000","last_peered":"2023-10-06T03:53:44.655090+0000","last_clean":"2023-10-06T03:53:44.655090+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:53:44.655090+0000","last_undegraded":"2023-10-06T03:53:44.655090+0000","last_fullsized":"2023-10-06T03:53:44.655090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.656254+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:53:44.656254+0000","last_peered":"2023-10-06T03:53:44.656254+0000","last_clean":"2023-10-06T03:53:44.656254+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:53:44.656254+0000","last_undegraded":"2023-10-06T03:53:44.656254+0000","last_fullsized":"2023-10-06T03:53:44.656254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644399+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:53:44.644399+0000","last_peered":"2023-10-06T03:53:44.644399+0000","last_clean":"2023-10-06T03:53:44.644399+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:53:44.644399+0000","last_undegraded":"2023-10-06T03:53:44.644399+0000","last_fullsized":"2023-10-06T03:53:44.644399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669987+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:53:44.669987+0000","last_peered":"2023-10-06T03:53:44.669987+0000","last_clean":"2023-10-06T03:53:44.669987+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:53:44.669987+0000","last_undegraded":"2023-10-06T03:53:44.669987+0000","last_fullsized":"2023-10-06T03:53:44.669987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669154+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:53:44.669154+0000","last_peered":"2023-10-06T03:53:44.669154+0000","last_clean":"2023-10-06T03:53:44.669154+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:53:44.669154+0000","last_undegraded":"2023-10-06T03:53:44.669154+0000","last_fullsized":"2023-10-06T03:53:44.669154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":872448,"data_stored":682740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":90620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":91244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":282624,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":90710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301628,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070212,"statfs":{"total":96636764160,"available":96327897088,"internally_reserved":0,"allocated":249856,"data_stored":90620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":847872,"data_stored":681542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:53:48.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 Processor -- start 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 -- start start 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f49cc142e30 0x7f49cc14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0b1eb0 con 0x7f49cc0b24b0 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc06eb60 con 0x7f49cc06cc30 2023-10-06T03:53:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.283+0000 7f49cbfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49cc0b1580 con 0x7f49cc142e30 2023-10-06T03:53:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49caffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f49cc0b24b0 0x7f49cc06d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49368/0 (socket says 172.21.15.57:49368) 2023-10-06T03:53:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49caffd700 1 -- 172.21.15.57:0/633201846 learned_addr learned my addr 172.21.15.57:0/633201846 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cb7fe700 1 --2- 172.21.15.57:0/633201846 >> v2:172.21.15.105:3300/0 conn(0x7f49cc142e30 0x7f49cc14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100812669 0 0) 0x7f49cc0b1eb0 con 0x7f49cc0b24b0 2023-10-06T03:53:48.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b8003570 con 0x7f49cc0b24b0 2023-10-06T03:53:48.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516352539 0 0) 0x7f49cc06eb60 con 0x7f49cc06cc30 2023-10-06T03:53:48.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49cc0b1eb0 con 0x7f49cc06cc30 2023-10-06T03:53:48.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cb7fe700 1 -- 172.21.15.57:0/633201846 >> v1:172.21.15.105:6789/0 conn(0x7f49cc06cc30 legacy=0x7f49cc142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cb7fe700 1 -- 172.21.15.57:0/633201846 >> v1:172.21.15.57:6789/0 conn(0x7f49cc0b24b0 legacy=0x7f49cc06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033038396 0 0) 0x7f49b8003570 con 0x7f49cc0b24b0 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cb7fe700 1 -- 172.21.15.57:0/633201846 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0b1860 con 0x7f49cc142e30 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cb7fe700 1 --2- 172.21.15.57:0/633201846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc142e30 0x7f49cc14ac10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098e0 tx=0x7f49b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446709cdffce8c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc001470 con 0x7f49cc142e30 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4011420 con 0x7f49cc142e30 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49c9ffb700 1 -- 172.21.15.57:0/633201846 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40117a0 con 0x7f49cc142e30 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 -- 172.21.15.57:0/633201846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc142e30 msgr2=0x7f49cc14ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 --2- 172.21.15.57:0/633201846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc142e30 0x7f49cc14ac10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098e0 tx=0x7f49b40091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 -- 172.21.15.57:0/633201846 shutdown_connections 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 --2- 172.21.15.57:0/633201846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc142e30 0x7f49cc14ac10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 -- 172.21.15.57:0/633201846 >> 172.21.15.57:0/633201846 conn(0x7f49cc068180 msgr2=0x7f49cc068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:48.296 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 -- 172.21.15.57:0/633201846 shutdown_connections 2023-10-06T03:53:48.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.287+0000 7f49cbfff700 1 -- 172.21.15.57:0/633201846 wait complete. 2023-10-06T03:53:48.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 Processor -- start 2023-10-06T03:53:48.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 -- start start 2023-10-06T03:53:48.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49cc06cc30 0x7f49cc1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc0b24b0 0x7f49cc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0a5ac0 con 0x7f49cc142e30 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0a4d10 con 0x7f49cc0b24b0 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cbfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc0ac670 con 0x7f49cc06cc30 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49caffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49cc06cc30 0x7f49cc1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49ca7fc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc0b24b0 0x7f49cc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46778/0 (socket says 172.21.15.57:46778) 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.291+0000 7f49cb7fe700 1 -- 172.21.15.57:0/2374503791 learned_addr learned my addr 172.21.15.57:0/2374503791 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:48.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 -- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49cc06cc30 msgr2=0x7f49cc1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49cc06cc30 0x7f49cc1536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 -- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc0b24b0 msgr2=0x7f49cc0a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc0b24b0 0x7f49cc0a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 -- 172.21.15.57:0/2374503791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009420 con 0x7f49cc142e30 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cb7fe700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ed0 tx=0x7f49b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b401cd90 con 0x7f49cc142e30 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40193f0 con 0x7f49cc142e30 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc0a8300 con 0x7f49cc142e30 2023-10-06T03:53:48.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40197b0 con 0x7f49cc142e30 2023-10-06T03:53:48.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.295+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc0ac070 con 0x7f49cc142e30 2023-10-06T03:53:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f49b4019b20 con 0x7f49cc142e30 2023-10-06T03:53:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49cc0a4ae0 con 0x7f49cc142e30 2023-10-06T03:53:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49c2ffd700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 0x7f49ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f49b407db20 con 0x7f49cc142e30 2023-10-06T03:53:48.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49caffd700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 0x7f49ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.299+0000 7f49caffd700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 0x7f49ac062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0011e0 tx=0x7f49bc001620 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.303+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f49cc0a4ae0 con 0x7f49cc142e30 2023-10-06T03:53:48.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.463+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49cc0a4e80 con 0x7f49ac060550 2023-10-06T03:53:48.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.479+0000 7f49c2ffd700 1 -- 172.21.15.57:0/2374503791 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286558 (secure 0 0 0) 0x7f49cc0a4e80 con 0x7f49ac060550 2023-10-06T03:53:48.488 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:48.500 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 msgr2=0x7f49ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 0x7f49ac062a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0011e0 tx=0x7f49bc001620 comp rx=0 tx=0).stop 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 msgr2=0x7f49cc145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ed0 tx=0x7f49b4016000 comp rx=0 tx=0).stop 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 shutdown_connections 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f49ac060550 0x7f49ac062a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49cc142e30 0x7f49cc145180 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49cc0b24b0 0x7f49cc0a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 --2- 172.21.15.57:0/2374503791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49cc06cc30 0x7f49cc1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 >> 172.21.15.57:0/2374503791 conn(0x7f49cc068180 msgr2=0x7f49cc143940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 shutdown_connections 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.487+0000 7f49cbfff700 1 -- 172.21.15.57:0/2374503791 wait complete. 2023-10-06T03:53:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:53:48.506 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T03:53:46.624106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397888,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576832,"statfs":{"total":773094113280,"available":770638675968,"internally_reserved":0,"allocated":3276800,"data_stored":1923590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.008792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667295+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:53:44.667295+0000","last_peered":"2023-10-06T03:53:44.667295+0000","last_clean":"2023-10-06T03:53:44.667295+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:53:44.667295+0000","last_undegraded":"2023-10-06T03:53:44.667295+0000","last_fullsized":"2023-10-06T03:53:44.667295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665648+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:53:44.665648+0000","last_peered":"2023-10-06T03:53:44.665648+0000","last_clean":"2023-10-06T03:53:44.665648+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:53:44.665648+0000","last_undegraded":"2023-10-06T03:53:44.665648+0000","last_fullsized":"2023-10-06T03:53:44.665648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669768+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:53:44.669768+0000","last_peered":"2023-10-06T03:53:44.669768+0000","last_clean":"2023-10-06T03:53:44.669768+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:53:44.669768+0000","last_undegraded":"2023-10-06T03:53:44.669768+0000","last_fullsized":"2023-10-06T03:53:44.669768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662122+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:53:44.662122+0000","last_peered":"2023-10-06T03:53:44.662122+0000","last_clean":"2023-10-06T03:53:44.662122+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:53:44.662122+0000","last_undegraded":"2023-10-06T03:53:44.662122+0000","last_fullsized":"2023-10-06T03:53:44.662122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659209+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:53:44.659209+0000","last_peered":"2023-10-06T03:53:44.659209+0000","last_clean":"2023-10-06T03:53:44.659209+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:53:44.659209+0000","last_undegraded":"2023-10-06T03:53:44.659209+0000","last_fullsized":"2023-10-06T03:53:44.659209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667704+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:53:44.667704+0000","last_peered":"2023-10-06T03:53:44.667704+0000","last_clean":"2023-10-06T03:53:44.667704+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:53:44.667704+0000","last_undegraded":"2023-10-06T03:53:44.667704+0000","last_fullsized":"2023-10-06T03:53:44.667704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662491+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:53:44.662491+0000","last_peered":"2023-10-06T03:53:44.662491+0000","last_clean":"2023-10-06T03:53:44.662491+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:53:44.662491+0000","last_undegraded":"2023-10-06T03:53:44.662491+0000","last_fullsized":"2023-10-06T03:53:44.662491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655682+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:53:44.655682+0000","last_peered":"2023-10-06T03:53:44.655682+0000","last_clean":"2023-10-06T03:53:44.655682+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:53:44.655682+0000","last_undegraded":"2023-10-06T03:53:44.655682+0000","last_fullsized":"2023-10-06T03:53:44.655682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668756+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:53:44.668756+0000","last_peered":"2023-10-06T03:53:44.668756+0000","last_clean":"2023-10-06T03:53:44.668756+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:53:44.668756+0000","last_undegraded":"2023-10-06T03:53:44.668756+0000","last_fullsized":"2023-10-06T03:53:44.668756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668983+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:53:44.668983+0000","last_peered":"2023-10-06T03:53:44.668983+0000","last_clean":"2023-10-06T03:53:44.668983+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:53:44.668983+0000","last_undegraded":"2023-10-06T03:53:44.668983+0000","last_fullsized":"2023-10-06T03:53:44.668983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668016+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:53:44.668016+0000","last_peered":"2023-10-06T03:53:44.668016+0000","last_clean":"2023-10-06T03:53:44.668016+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:53:44.668016+0000","last_undegraded":"2023-10-06T03:53:44.668016+0000","last_fullsized":"2023-10-06T03:53:44.668016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672653+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:53:44.672653+0000","last_peered":"2023-10-06T03:53:44.672653+0000","last_clean":"2023-10-06T03:53:44.672653+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:53:44.672653+0000","last_undegraded":"2023-10-06T03:53:44.672653+0000","last_fullsized":"2023-10-06T03:53:44.672653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672575+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:53:44.672575+0000","last_peered":"2023-10-06T03:53:44.672575+0000","last_clean":"2023-10-06T03:53:44.672575+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:53:44.672575+0000","last_undegraded":"2023-10-06T03:53:44.672575+0000","last_fullsized":"2023-10-06T03:53:44.672575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664859+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:53:44.664859+0000","last_peered":"2023-10-06T03:53:44.664859+0000","last_clean":"2023-10-06T03:53:44.664859+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:53:44.664859+0000","last_undegraded":"2023-10-06T03:53:44.664859+0000","last_fullsized":"2023-10-06T03:53:44.664859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662631+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:53:44.662631+0000","last_peered":"2023-10-06T03:53:44.662631+0000","last_clean":"2023-10-06T03:53:44.662631+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:53:44.662631+0000","last_undegraded":"2023-10-06T03:53:44.662631+0000","last_fullsized":"2023-10-06T03:53:44.662631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667627+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:53:44.667627+0000","last_peered":"2023-10-06T03:53:44.667627+0000","last_clean":"2023-10-06T03:53:44.667627+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:53:44.667627+0000","last_undegraded":"2023-10-06T03:53:44.667627+0000","last_fullsized":"2023-10-06T03:53:44.667627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668966+0000","last_change":"2023-10-06T03:53:44.668966+0000","last_active":"2023-10-06T03:53:44.668966+0000","last_peered":"2023-10-06T03:53:44.668966+0000","last_clean":"2023-10-06T03:53:44.668966+0000","last_became_active":"2023-10-06T03:53:44.668702+0000","last_became_peered":"2023-10-06T03:53:44.668702+0000","last_unstale":"2023-10-06T03:53:44.668966+0000","last_undegraded":"2023-10-06T03:53:44.668966+0000","last_fullsized":"2023-10-06T03:53:44.668966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669820+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:53:44.669820+0000","last_peered":"2023-10-06T03:53:44.669820+0000","last_clean":"2023-10-06T03:53:44.669820+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:53:44.669820+0000","last_undegraded":"2023-10-06T03:53:44.669820+0000","last_fullsized":"2023-10-06T03:53:44.669820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.677385+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:53:44.677385+0000","last_peered":"2023-10-06T03:53:44.677385+0000","last_clean":"2023-10-06T03:53:44.677385+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:53:44.677385+0000","last_undegraded":"2023-10-06T03:53:44.677385+0000","last_fullsized":"2023-10-06T03:53:44.677385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668754+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:53:44.668754+0000","last_peered":"2023-10-06T03:53:44.668754+0000","last_clean":"2023-10-06T03:53:44.668754+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:53:44.668754+0000","last_undegraded":"2023-10-06T03:53:44.668754+0000","last_fullsized":"2023-10-06T03:53:44.668754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673407+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:53:44.673407+0000","last_peered":"2023-10-06T03:53:44.673407+0000","last_clean":"2023-10-06T03:53:44.673407+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:53:44.673407+0000","last_undegraded":"2023-10-06T03:53:44.673407+0000","last_fullsized":"2023-10-06T03:53:44.673407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662003+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:53:44.662003+0000","last_peered":"2023-10-06T03:53:44.662003+0000","last_clean":"2023-10-06T03:53:44.662003+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:53:44.662003+0000","last_undegraded":"2023-10-06T03:53:44.662003+0000","last_fullsized":"2023-10-06T03:53:44.662003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673046+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:53:44.673046+0000","last_peered":"2023-10-06T03:53:44.673046+0000","last_clean":"2023-10-06T03:53:44.673046+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:53:44.673046+0000","last_undegraded":"2023-10-06T03:53:44.673046+0000","last_fullsized":"2023-10-06T03:53:44.673046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661181+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:53:44.661181+0000","last_peered":"2023-10-06T03:53:44.661181+0000","last_clean":"2023-10-06T03:53:44.661181+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:53:44.661181+0000","last_undegraded":"2023-10-06T03:53:44.661181+0000","last_fullsized":"2023-10-06T03:53:44.661181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672616+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:53:44.672616+0000","last_peered":"2023-10-06T03:53:44.672616+0000","last_clean":"2023-10-06T03:53:44.672616+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:53:44.672616+0000","last_undegraded":"2023-10-06T03:53:44.672616+0000","last_fullsized":"2023-10-06T03:53:44.672616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671192+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:53:44.671192+0000","last_peered":"2023-10-06T03:53:44.671192+0000","last_clean":"2023-10-06T03:53:44.671192+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:53:44.671192+0000","last_undegraded":"2023-10-06T03:53:44.671192+0000","last_fullsized":"2023-10-06T03:53:44.671192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663576+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:53:44.663576+0000","last_peered":"2023-10-06T03:53:44.663576+0000","last_clean":"2023-10-06T03:53:44.663576+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:53:44.663576+0000","last_undegraded":"2023-10-06T03:53:44.663576+0000","last_fullsized":"2023-10-06T03:53:44.663576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660454+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:53:44.660454+0000","last_peered":"2023-10-06T03:53:44.660454+0000","last_clean":"2023-10-06T03:53:44.660454+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:53:44.660454+0000","last_undegraded":"2023-10-06T03:53:44.660454+0000","last_fullsized":"2023-10-06T03:53:44.660454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665103+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:53:44.665103+0000","last_peered":"2023-10-06T03:53:44.665103+0000","last_clean":"2023-10-06T03:53:44.665103+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:53:44.665103+0000","last_undegraded":"2023-10-06T03:53:44.665103+0000","last_fullsized":"2023-10-06T03:53:44.665103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670029+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:53:44.670029+0000","last_peered":"2023-10-06T03:53:44.670029+0000","last_clean":"2023-10-06T03:53:44.670029+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:53:44.670029+0000","last_undegraded":"2023-10-06T03:53:44.670029+0000","last_fullsized":"2023-10-06T03:53:44.670029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671536+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:53:44.671536+0000","last_peered":"2023-10-06T03:53:44.671536+0000","last_clean":"2023-10-06T03:53:44.671536+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:53:44.671536+0000","last_undegraded":"2023-10-06T03:53:44.671536+0000","last_fullsized":"2023-10-06T03:53:44.671536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664518+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:53:44.664518+0000","last_peered":"2023-10-06T03:53:44.664518+0000","last_clean":"2023-10-06T03:53:44.664518+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:53:44.664518+0000","last_undegraded":"2023-10-06T03:53:44.664518+0000","last_fullsized":"2023-10-06T03:53:44.664518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669851+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:53:44.669851+0000","last_peered":"2023-10-06T03:53:44.669851+0000","last_clean":"2023-10-06T03:53:44.669851+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:53:44.669851+0000","last_undegraded":"2023-10-06T03:53:44.669851+0000","last_fullsized":"2023-10-06T03:53:44.669851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668369+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:53:44.668369+0000","last_peered":"2023-10-06T03:53:44.668369+0000","last_clean":"2023-10-06T03:53:44.668369+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:53:44.668369+0000","last_undegraded":"2023-10-06T03:53:44.668369+0000","last_fullsized":"2023-10-06T03:53:44.668369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661057+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:53:44.661057+0000","last_peered":"2023-10-06T03:53:44.661057+0000","last_clean":"2023-10-06T03:53:44.661057+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:53:44.661057+0000","last_undegraded":"2023-10-06T03:53:44.661057+0000","last_fullsized":"2023-10-06T03:53:44.661057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666260+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:53:43.666260+0000","last_peered":"2023-10-06T03:53:43.666260+0000","last_clean":"2023-10-06T03:53:43.666260+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:53:43.666260+0000","last_undegraded":"2023-10-06T03:53:43.666260+0000","last_fullsized":"2023-10-06T03:53:43.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668434+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:53:44.668434+0000","last_peered":"2023-10-06T03:53:44.668434+0000","last_clean":"2023-10-06T03:53:44.668434+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:53:44.668434+0000","last_undegraded":"2023-10-06T03:53:44.668434+0000","last_fullsized":"2023-10-06T03:53:44.668434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.658248+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:53:43.658248+0000","last_peered":"2023-10-06T03:53:43.658248+0000","last_clean":"2023-10-06T03:53:43.658248+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:53:43.658248+0000","last_undegraded":"2023-10-06T03:53:43.658248+0000","last_fullsized":"2023-10-06T03:53:43.658248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663208+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:53:44.663208+0000","last_peered":"2023-10-06T03:53:44.663208+0000","last_clean":"2023-10-06T03:53:44.663208+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:53:44.663208+0000","last_undegraded":"2023-10-06T03:53:44.663208+0000","last_fullsized":"2023-10-06T03:53:44.663208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673188+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:53:44.673188+0000","last_peered":"2023-10-06T03:53:44.673188+0000","last_clean":"2023-10-06T03:53:44.673188+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:53:44.673188+0000","last_undegraded":"2023-10-06T03:53:44.673188+0000","last_fullsized":"2023-10-06T03:53:44.673188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.653551+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:53:44.653551+0000","last_peered":"2023-10-06T03:53:44.653551+0000","last_clean":"2023-10-06T03:53:44.653551+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:53:44.653551+0000","last_undegraded":"2023-10-06T03:53:44.653551+0000","last_fullsized":"2023-10-06T03:53:44.653551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659297+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:53:44.659297+0000","last_peered":"2023-10-06T03:53:44.659297+0000","last_clean":"2023-10-06T03:53:44.659297+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:53:44.659297+0000","last_undegraded":"2023-10-06T03:53:44.659297+0000","last_fullsized":"2023-10-06T03:53:44.659297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668137+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:53:44.668137+0000","last_peered":"2023-10-06T03:53:44.668137+0000","last_clean":"2023-10-06T03:53:44.668137+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:53:44.668137+0000","last_undegraded":"2023-10-06T03:53:44.668137+0000","last_fullsized":"2023-10-06T03:53:44.668137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670120+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:53:44.670120+0000","last_peered":"2023-10-06T03:53:44.670120+0000","last_clean":"2023-10-06T03:53:44.670120+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:53:44.670120+0000","last_undegraded":"2023-10-06T03:53:44.670120+0000","last_fullsized":"2023-10-06T03:53:44.670120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654020+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:53:44.654020+0000","last_peered":"2023-10-06T03:53:44.654020+0000","last_clean":"2023-10-06T03:53:44.654020+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:53:44.654020+0000","last_undegraded":"2023-10-06T03:53:44.654020+0000","last_fullsized":"2023-10-06T03:53:44.654020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663448+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:53:44.663448+0000","last_peered":"2023-10-06T03:53:44.663448+0000","last_clean":"2023-10-06T03:53:44.663448+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:53:44.663448+0000","last_undegraded":"2023-10-06T03:53:44.663448+0000","last_fullsized":"2023-10-06T03:53:44.663448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.668803+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:53:43.668803+0000","last_peered":"2023-10-06T03:53:43.668803+0000","last_clean":"2023-10-06T03:53:43.668803+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:53:43.668803+0000","last_undegraded":"2023-10-06T03:53:43.668803+0000","last_fullsized":"2023-10-06T03:53:43.668803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664065+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:53:44.664065+0000","last_peered":"2023-10-06T03:53:44.664065+0000","last_clean":"2023-10-06T03:53:44.664065+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:53:44.664065+0000","last_undegraded":"2023-10-06T03:53:44.664065+0000","last_fullsized":"2023-10-06T03:53:44.664065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.671648+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:53:44.671648+0000","last_peered":"2023-10-06T03:53:44.671648+0000","last_clean":"2023-10-06T03:53:44.671648+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:53:44.671648+0000","last_undegraded":"2023-10-06T03:53:44.671648+0000","last_fullsized":"2023-10-06T03:53:44.671648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668734+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:53:44.668734+0000","last_peered":"2023-10-06T03:53:44.668734+0000","last_clean":"2023-10-06T03:53:44.668734+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:53:44.668734+0000","last_undegraded":"2023-10-06T03:53:44.668734+0000","last_fullsized":"2023-10-06T03:53:44.668734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.654591+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:53:43.654591+0000","last_peered":"2023-10-06T03:53:43.654591+0000","last_clean":"2023-10-06T03:53:43.654591+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:53:43.654591+0000","last_undegraded":"2023-10-06T03:53:43.654591+0000","last_fullsized":"2023-10-06T03:53:43.654591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669955+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:53:44.669955+0000","last_peered":"2023-10-06T03:53:44.669955+0000","last_clean":"2023-10-06T03:53:44.669955+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:53:44.669955+0000","last_undegraded":"2023-10-06T03:53:44.669955+0000","last_fullsized":"2023-10-06T03:53:44.669955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.638833+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:53:44.638833+0000","last_peered":"2023-10-06T03:53:44.638833+0000","last_clean":"2023-10-06T03:53:44.638833+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:53:44.638833+0000","last_undegraded":"2023-10-06T03:53:44.638833+0000","last_fullsized":"2023-10-06T03:53:44.638833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669986+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:53:44.669986+0000","last_peered":"2023-10-06T03:53:44.669986+0000","last_clean":"2023-10-06T03:53:44.669986+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:53:44.669986+0000","last_undegraded":"2023-10-06T03:53:44.669986+0000","last_fullsized":"2023-10-06T03:53:44.669986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.669212+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:53:43.669212+0000","last_peered":"2023-10-06T03:53:43.669212+0000","last_clean":"2023-10-06T03:53:43.669212+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:53:43.669212+0000","last_undegraded":"2023-10-06T03:53:43.669212+0000","last_fullsized":"2023-10-06T03:53:43.669212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670493+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:53:44.670493+0000","last_peered":"2023-10-06T03:53:44.670493+0000","last_clean":"2023-10-06T03:53:44.670493+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:53:44.670493+0000","last_undegraded":"2023-10-06T03:53:44.670493+0000","last_fullsized":"2023-10-06T03:53:44.670493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.649197+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:53:43.649197+0000","last_peered":"2023-10-06T03:53:43.649197+0000","last_clean":"2023-10-06T03:53:43.649197+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:53:43.649197+0000","last_undegraded":"2023-10-06T03:53:43.649197+0000","last_fullsized":"2023-10-06T03:53:43.649197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.645491+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:53:43.645491+0000","last_peered":"2023-10-06T03:53:43.645491+0000","last_clean":"2023-10-06T03:53:43.645491+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:53:43.645491+0000","last_undegraded":"2023-10-06T03:53:43.645491+0000","last_fullsized":"2023-10-06T03:53:43.645491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.670989+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:53:43.670989+0000","last_peered":"2023-10-06T03:53:43.670989+0000","last_clean":"2023-10-06T03:53:43.670989+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:53:43.670989+0000","last_undegraded":"2023-10-06T03:53:43.670989+0000","last_fullsized":"2023-10-06T03:53:43.670989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661889+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:53:44.661889+0000","last_peered":"2023-10-06T03:53:44.661889+0000","last_clean":"2023-10-06T03:53:44.661889+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:53:44.661889+0000","last_undegraded":"2023-10-06T03:53:44.661889+0000","last_fullsized":"2023-10-06T03:53:44.661889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.649151+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:53:43.649151+0000","last_peered":"2023-10-06T03:53:43.649151+0000","last_clean":"2023-10-06T03:53:43.649151+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:53:43.649151+0000","last_undegraded":"2023-10-06T03:53:43.649151+0000","last_fullsized":"2023-10-06T03:53:43.649151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666125+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:53:43.666125+0000","last_peered":"2023-10-06T03:53:43.666125+0000","last_clean":"2023-10-06T03:53:43.666125+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:53:43.666125+0000","last_undegraded":"2023-10-06T03:53:43.666125+0000","last_fullsized":"2023-10-06T03:53:43.666125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662895+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:53:44.662895+0000","last_peered":"2023-10-06T03:53:44.662895+0000","last_clean":"2023-10-06T03:53:44.662895+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:53:44.662895+0000","last_undegraded":"2023-10-06T03:53:44.662895+0000","last_fullsized":"2023-10-06T03:53:44.662895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652382+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:53:44.652382+0000","last_peered":"2023-10-06T03:53:44.652382+0000","last_clean":"2023-10-06T03:53:44.652382+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:53:44.652382+0000","last_undegraded":"2023-10-06T03:53:44.652382+0000","last_fullsized":"2023-10-06T03:53:44.652382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.660448+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:53:43.660448+0000","last_peered":"2023-10-06T03:53:43.660448+0000","last_clean":"2023-10-06T03:53:43.660448+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:53:43.660448+0000","last_undegraded":"2023-10-06T03:53:43.660448+0000","last_fullsized":"2023-10-06T03:53:43.660448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659941+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:53:44.659941+0000","last_peered":"2023-10-06T03:53:44.659941+0000","last_clean":"2023-10-06T03:53:44.659941+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:53:44.659941+0000","last_undegraded":"2023-10-06T03:53:44.659941+0000","last_fullsized":"2023-10-06T03:53:44.659941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.645913+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:53:43.645913+0000","last_peered":"2023-10-06T03:53:43.645913+0000","last_clean":"2023-10-06T03:53:43.645913+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:53:43.645913+0000","last_undegraded":"2023-10-06T03:53:43.645913+0000","last_fullsized":"2023-10-06T03:53:43.645913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641446+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:53:44.641446+0000","last_peered":"2023-10-06T03:53:44.641446+0000","last_clean":"2023-10-06T03:53:44.641446+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:53:44.641446+0000","last_undegraded":"2023-10-06T03:53:44.641446+0000","last_fullsized":"2023-10-06T03:53:44.641446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672856+0000","last_change":"2023-10-06T03:53:44.672856+0000","last_active":"2023-10-06T03:53:44.672856+0000","last_peered":"2023-10-06T03:53:44.672856+0000","last_clean":"2023-10-06T03:53:44.672856+0000","last_became_active":"2023-10-06T03:53:44.670507+0000","last_became_peered":"2023-10-06T03:53:44.670507+0000","last_unstale":"2023-10-06T03:53:44.672856+0000","last_undegraded":"2023-10-06T03:53:44.672856+0000","last_fullsized":"2023-10-06T03:53:44.672856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.668775+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:53:43.668775+0000","last_peered":"2023-10-06T03:53:43.668775+0000","last_clean":"2023-10-06T03:53:43.668775+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:53:43.668775+0000","last_undegraded":"2023-10-06T03:53:43.668775+0000","last_fullsized":"2023-10-06T03:53:43.668775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.647669+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:53:43.647669+0000","last_peered":"2023-10-06T03:53:43.647669+0000","last_clean":"2023-10-06T03:53:43.647669+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:53:43.647669+0000","last_undegraded":"2023-10-06T03:53:43.647669+0000","last_fullsized":"2023-10-06T03:53:43.647669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660124+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:53:44.660124+0000","last_peered":"2023-10-06T03:53:44.660124+0000","last_clean":"2023-10-06T03:53:44.660124+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:53:44.660124+0000","last_undegraded":"2023-10-06T03:53:44.660124+0000","last_fullsized":"2023-10-06T03:53:44.660124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.665902+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:53:43.665902+0000","last_peered":"2023-10-06T03:53:43.665902+0000","last_clean":"2023-10-06T03:53:43.665902+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:53:43.665902+0000","last_undegraded":"2023-10-06T03:53:43.665902+0000","last_fullsized":"2023-10-06T03:53:43.665902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.653348+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:53:43.653348+0000","last_peered":"2023-10-06T03:53:43.653348+0000","last_clean":"2023-10-06T03:53:43.653348+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:53:43.653348+0000","last_undegraded":"2023-10-06T03:53:43.653348+0000","last_fullsized":"2023-10-06T03:53:43.653348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663854+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:53:44.663854+0000","last_peered":"2023-10-06T03:53:44.663854+0000","last_clean":"2023-10-06T03:53:44.663854+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:53:44.663854+0000","last_undegraded":"2023-10-06T03:53:44.663854+0000","last_fullsized":"2023-10-06T03:53:44.663854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661990+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:53:44.661990+0000","last_peered":"2023-10-06T03:53:44.661990+0000","last_clean":"2023-10-06T03:53:44.661990+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:53:44.661990+0000","last_undegraded":"2023-10-06T03:53:44.661990+0000","last_fullsized":"2023-10-06T03:53:44.661990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.647522+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:53:43.647522+0000","last_peered":"2023-10-06T03:53:43.647522+0000","last_clean":"2023-10-06T03:53:43.647522+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:53:43.647522+0000","last_undegraded":"2023-10-06T03:53:43.647522+0000","last_fullsized":"2023-10-06T03:53:43.647522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661587+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:53:44.661587+0000","last_peered":"2023-10-06T03:53:44.661587+0000","last_clean":"2023-10-06T03:53:44.661587+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:53:44.661587+0000","last_undegraded":"2023-10-06T03:53:44.661587+0000","last_fullsized":"2023-10-06T03:53:44.661587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.671185+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:53:43.671185+0000","last_peered":"2023-10-06T03:53:43.671185+0000","last_clean":"2023-10-06T03:53:43.671185+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:53:43.671185+0000","last_undegraded":"2023-10-06T03:53:43.671185+0000","last_fullsized":"2023-10-06T03:53:43.671185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.642152+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:53:43.642152+0000","last_peered":"2023-10-06T03:53:43.642152+0000","last_clean":"2023-10-06T03:53:43.642152+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:53:43.642152+0000","last_undegraded":"2023-10-06T03:53:43.642152+0000","last_fullsized":"2023-10-06T03:53:43.642152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654585+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:53:44.654585+0000","last_peered":"2023-10-06T03:53:44.654585+0000","last_clean":"2023-10-06T03:53:44.654585+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:53:44.654585+0000","last_undegraded":"2023-10-06T03:53:44.654585+0000","last_fullsized":"2023-10-06T03:53:44.654585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668210+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:53:44.668210+0000","last_peered":"2023-10-06T03:53:44.668210+0000","last_clean":"2023-10-06T03:53:44.668210+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:53:44.668210+0000","last_undegraded":"2023-10-06T03:53:44.668210+0000","last_fullsized":"2023-10-06T03:53:44.668210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672268+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:53:44.672268+0000","last_peered":"2023-10-06T03:53:44.672268+0000","last_clean":"2023-10-06T03:53:44.672268+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:53:44.672268+0000","last_undegraded":"2023-10-06T03:53:44.672268+0000","last_fullsized":"2023-10-06T03:53:44.672268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672455+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:53:44.672455+0000","last_peered":"2023-10-06T03:53:44.672455+0000","last_clean":"2023-10-06T03:53:44.672455+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:53:44.672455+0000","last_undegraded":"2023-10-06T03:53:44.672455+0000","last_fullsized":"2023-10-06T03:53:44.672455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670554+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:53:44.670554+0000","last_peered":"2023-10-06T03:53:44.670554+0000","last_clean":"2023-10-06T03:53:44.670554+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:53:44.670554+0000","last_undegraded":"2023-10-06T03:53:44.670554+0000","last_fullsized":"2023-10-06T03:53:44.670554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.657592+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:53:43.657592+0000","last_peered":"2023-10-06T03:53:43.657592+0000","last_clean":"2023-10-06T03:53:43.657592+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:53:43.657592+0000","last_undegraded":"2023-10-06T03:53:43.657592+0000","last_fullsized":"2023-10-06T03:53:43.657592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.664680+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:53:44.664680+0000","last_peered":"2023-10-06T03:53:44.664680+0000","last_clean":"2023-10-06T03:53:44.664680+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:53:44.664680+0000","last_undegraded":"2023-10-06T03:53:44.664680+0000","last_fullsized":"2023-10-06T03:53:44.664680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.666255+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:53:43.666255+0000","last_peered":"2023-10-06T03:53:43.666255+0000","last_clean":"2023-10-06T03:53:43.666255+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:53:43.666255+0000","last_undegraded":"2023-10-06T03:53:43.666255+0000","last_fullsized":"2023-10-06T03:53:43.666255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669613+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:53:44.669613+0000","last_peered":"2023-10-06T03:53:44.669613+0000","last_clean":"2023-10-06T03:53:44.669613+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:53:44.669613+0000","last_undegraded":"2023-10-06T03:53:44.669613+0000","last_fullsized":"2023-10-06T03:53:44.669613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661979+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:53:44.661979+0000","last_peered":"2023-10-06T03:53:44.661979+0000","last_clean":"2023-10-06T03:53:44.661979+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:53:44.661979+0000","last_undegraded":"2023-10-06T03:53:44.661979+0000","last_fullsized":"2023-10-06T03:53:44.661979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.676262+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:53:43.676262+0000","last_peered":"2023-10-06T03:53:43.676262+0000","last_clean":"2023-10-06T03:53:43.676262+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:53:43.676262+0000","last_undegraded":"2023-10-06T03:53:43.676262+0000","last_fullsized":"2023-10-06T03:53:43.676262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.663603+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:53:44.663603+0000","last_peered":"2023-10-06T03:53:44.663603+0000","last_clean":"2023-10-06T03:53:44.663603+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:53:44.663603+0000","last_undegraded":"2023-10-06T03:53:44.663603+0000","last_fullsized":"2023-10-06T03:53:44.663603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T03:53:43.671499+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:53:43.671499+0000","last_peered":"2023-10-06T03:53:43.671499+0000","last_clean":"2023-10-06T03:53:43.671499+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:53:43.671499+0000","last_undegraded":"2023-10-06T03:53:43.671499+0000","last_fullsized":"2023-10-06T03:53:43.671499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661346+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:53:44.661346+0000","last_peered":"2023-10-06T03:53:44.661346+0000","last_clean":"2023-10-06T03:53:44.661346+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:53:44.661346+0000","last_undegraded":"2023-10-06T03:53:44.661346+0000","last_fullsized":"2023-10-06T03:53:44.661346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660417+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:53:44.660417+0000","last_peered":"2023-10-06T03:53:44.660417+0000","last_clean":"2023-10-06T03:53:44.660417+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:53:44.660417+0000","last_undegraded":"2023-10-06T03:53:44.660417+0000","last_fullsized":"2023-10-06T03:53:44.660417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672673+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:53:44.672673+0000","last_peered":"2023-10-06T03:53:44.672673+0000","last_clean":"2023-10-06T03:53:44.672673+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:53:44.672673+0000","last_undegraded":"2023-10-06T03:53:44.672673+0000","last_fullsized":"2023-10-06T03:53:44.672673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652882+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:53:44.652882+0000","last_peered":"2023-10-06T03:53:44.652882+0000","last_clean":"2023-10-06T03:53:44.652882+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:53:44.652882+0000","last_undegraded":"2023-10-06T03:53:44.652882+0000","last_fullsized":"2023-10-06T03:53:44.652882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667758+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:53:44.667758+0000","last_peered":"2023-10-06T03:53:44.667758+0000","last_clean":"2023-10-06T03:53:44.667758+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:53:44.667758+0000","last_undegraded":"2023-10-06T03:53:44.667758+0000","last_fullsized":"2023-10-06T03:53:44.667758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655032+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:53:44.655032+0000","last_peered":"2023-10-06T03:53:44.655032+0000","last_clean":"2023-10-06T03:53:44.655032+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:53:44.655032+0000","last_undegraded":"2023-10-06T03:53:44.655032+0000","last_fullsized":"2023-10-06T03:53:44.655032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667741+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:53:44.667741+0000","last_peered":"2023-10-06T03:53:44.667741+0000","last_clean":"2023-10-06T03:53:44.667741+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:53:44.667741+0000","last_undegraded":"2023-10-06T03:53:44.667741+0000","last_fullsized":"2023-10-06T03:53:44.667741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655090+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:53:44.655090+0000","last_peered":"2023-10-06T03:53:44.655090+0000","last_clean":"2023-10-06T03:53:44.655090+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:53:44.655090+0000","last_undegraded":"2023-10-06T03:53:44.655090+0000","last_fullsized":"2023-10-06T03:53:44.655090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.656254+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:53:44.656254+0000","last_peered":"2023-10-06T03:53:44.656254+0000","last_clean":"2023-10-06T03:53:44.656254+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:53:44.656254+0000","last_undegraded":"2023-10-06T03:53:44.656254+0000","last_fullsized":"2023-10-06T03:53:44.656254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644399+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:53:44.644399+0000","last_peered":"2023-10-06T03:53:44.644399+0000","last_clean":"2023-10-06T03:53:44.644399+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:53:44.644399+0000","last_undegraded":"2023-10-06T03:53:44.644399+0000","last_fullsized":"2023-10-06T03:53:44.644399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669987+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:53:44.669987+0000","last_peered":"2023-10-06T03:53:44.669987+0000","last_clean":"2023-10-06T03:53:44.669987+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:53:44.669987+0000","last_undegraded":"2023-10-06T03:53:44.669987+0000","last_fullsized":"2023-10-06T03:53:44.669987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669154+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:53:44.669154+0000","last_peered":"2023-10-06T03:53:44.669154+0000","last_clean":"2023-10-06T03:53:44.669154+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:53:44.669154+0000","last_undegraded":"2023-10-06T03:53:44.669154+0000","last_fullsized":"2023-10-06T03:53:44.669154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":872448,"data_stored":682740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297532,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074308,"statfs":{"total":96636764160,"available":96332091392,"internally_reserved":0,"allocated":249856,"data_stored":90620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":91244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.119}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":282624,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301632,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070208,"statfs":{"total":96636764160,"available":96327892992,"internally_reserved":0,"allocated":253952,"data_stored":90710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301628,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070212,"statfs":{"total":96636764160,"available":96327897088,"internally_reserved":0,"allocated":249856,"data_stored":90620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302212,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069628,"statfs":{"total":96636764160,"available":96327299072,"internally_reserved":0,"allocated":847872,"data_stored":681542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:53:48.513 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:53:48.515 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:53:48.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:53:48.515 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:53:48.516 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:53:48.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 Processor -- start 2023-10-06T03:53:48.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 -- start start 2023-10-06T03:53:48.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 0x7f821c145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f821c1424b0 0x7f821c142930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c13bdb0 0x7f821c13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c142e70 con 0x7f821c1424b0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c1465e0 con 0x7f821c0a8ad0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f8220cc4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c146020 con 0x7f821c13bdb0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f821affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f821c1424b0 0x7f821c142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f821affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f821c1424b0 0x7f821c142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46788/0 (socket says 172.21.15.57:46788) 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f821affd700 1 -- 172.21.15.57:0/298267512 learned_addr learned my addr 172.21.15.57:0/298267512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.623+0000 7f821bfff700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c13bdb0 0x7f821c13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821b7fe700 1 --2- 172.21.15.57:0/298267512 >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 0x7f821c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 -- 172.21.15.57:0/298267512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c13bdb0 msgr2=0x7f821c13c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c13bdb0 0x7f821c13c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 -- 172.21.15.57:0/298267512 >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 msgr2=0x7f821c145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:48.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 --2- 172.21.15.57:0/298267512 >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 0x7f821c145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 -- 172.21.15.57:0/298267512 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c146300 con 0x7f821c1424b0 2023-10-06T03:53:48.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821b7fe700 1 --2- 172.21.15.57:0/298267512 >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 0x7f821c145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:48.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821affd700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c1424b0 0x7f821c142930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f821c0b3350 tx=0x7f8204009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c39287c483f8338 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821a7fc700 1 -- 172.21.15.57:0/298267512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400e070 con 0x7f821c1424b0 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821a7fc700 1 -- 172.21.15.57:0/298267512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400ba50 con 0x7f821c1424b0 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f821a7fc700 1 -- 172.21.15.57:0/298267512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040092e0 con 0x7f821c1424b0 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- 172.21.15.57:0/298267512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c1424b0 msgr2=0x7f821c142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c1424b0 0x7f821c142930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f821c0b3350 tx=0x7f8204009840 comp rx=0 tx=0).stop 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- 172.21.15.57:0/298267512 shutdown_connections 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c13bdb0 0x7f821c13c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- 172.21.15.57:0/298267512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c1424b0 0x7f821c142930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- 172.21.15.57:0/298267512 >> v2:172.21.15.105:3300/0 conn(0x7f821c0a8ad0 0x7f821c145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- 172.21.15.57:0/298267512 >> 172.21.15.57:0/298267512 conn(0x7f821c068180 msgr2=0x7f821c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- 172.21.15.57:0/298267512 shutdown_connections 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- 172.21.15.57:0/298267512 wait complete. 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 Processor -- start 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- start start 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 0x7f821c1432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c1424b0 0x7f821c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c143820 con 0x7f821c0a8ad0 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c0ac5c0 con 0x7f821c13bdb0 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.627+0000 7f8220cc4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c13c2b0 con 0x7f821c1424b0 2023-10-06T03:53:48.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46790/0 (socket says 172.21.15.57:46790) 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 -- 172.21.15.57:0/2086149382 learned_addr learned my addr 172.21.15.57:0/2086149382 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821bfff700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c1424b0 0x7f821c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821affd700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 0x7f821c1432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 -- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c1424b0 msgr2=0x7f821c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c1424b0 0x7f821c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 -- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 msgr2=0x7f821c1432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 0x7f821c1432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 -- 172.21.15.57:0/2086149382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204009ae0 con 0x7f821c0a8ad0 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821affd700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 0x7f821c1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:48.637 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f821b7fe700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c830 tx=0x7f820c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011600 con 0x7f821c0a8ad0 2023-10-06T03:53:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c011760 con 0x7f821c0a8ad0 2023-10-06T03:53:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c13c590 con 0x7f821c0a8ad0 2023-10-06T03:53:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011b20 con 0x7f821c0a8ad0 2023-10-06T03:53:48.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c140640 con 0x7f821c0a8ad0 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c06c150 con 0x7f821c0a8ad0 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f820c0193b0 con 0x7f821c0a8ad0 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.631+0000 7f82137fe700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 0x7f81fc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.635+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f820c07c900 con 0x7f821c0a8ad0 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.635+0000 7f821affd700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 0x7f81fc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.639 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.635+0000 7f821affd700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 0x7f81fc062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8204009880 tx=0x7f8204018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:48.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.639+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f820c04cd90 con 0x7f821c0a8ad0 2023-10-06T03:53:48.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.839+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f821c04b5c0 con 0x7f821c0a8ad0 2023-10-06T03:53:48.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.847+0000 7f82137fe700 1 -- 172.21.15.57:0/2086149382 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+154138 (secure 0 0 0) 0x7f820c015090 con 0x7f821c0a8ad0 2023-10-06T03:53:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 msgr2=0x7f81fc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 0x7f81fc062a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8204009880 tx=0x7f8204018000 comp rx=0 tx=0).stop 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 msgr2=0x7f821c06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c830 tx=0x7f820c008040 comp rx=0 tx=0).stop 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 shutdown_connections 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f81fc060550 0x7f81fc062a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f821c1424b0 0x7f821c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f821c13bdb0 0x7f821c1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 --2- 172.21.15.57:0/2086149382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f821c0a8ad0 0x7f821c06e9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 >> 172.21.15.57:0/2086149382 conn(0x7f821c068180 msgr2=0x7f821c147050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 shutdown_connections 2023-10-06T03:53:48.859 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.851+0000 7f8220cc4700 1 -- 172.21.15.57:0/2086149382 wait complete. 2023-10-06T03:53:48.869 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":33285},{"type":"v1","addr":"172.21.15.105:6833","nonce":33285}]},"active_addr":"172.21.15.105:6833/33285","active_change":"2023-10-06T03:53:24.607985+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1770567659}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1483739455}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":2699322353}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":2521724607}]}]} 2023-10-06T03:53:48.873 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:53:48.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:53:48.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:48.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.987+0000 7fd7fb59e700 1 Processor -- start 2023-10-06T03:53:48.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fb59e700 1 -- start start 2023-10-06T03:53:48.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7fc13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fb59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc143f30 con 0x7fd7fc140450 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fb59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0a9410 con 0x7fd7fc0a7df0 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0a9230 con 0x7fd7fc0add20 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd7fc140450 0x7fd7fc0aa920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49382/0 (socket says 172.21.15.57:49382) 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fad9d700 1 -- 172.21.15.57:0/493917717 learned_addr learned my addr 172.21.15.57:0/493917717 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995780026 0 0) 0x7fd7fc143f30 con 0x7fd7fc140450 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e8003570 con 0x7fd7fc140450 2023-10-06T03:53:48.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fa59c700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7fc13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:48.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601210795 0 0) 0x7fd7fc0a9410 con 0x7fd7fc0a7df0 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc143f30 con 0x7fd7fc0a7df0 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 510503202 0 0) 0x7fd7e8003570 con 0x7fd7fc140450 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 msgr2=0x7fd7fc13ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7fc13ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 >> v1:172.21.15.105:6789/0 conn(0x7fd7fc0a7df0 legacy=0x7fd7fc06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc1443c0 con 0x7fd7fc140450 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7fd7f40017f0 con 0x7fd7fc140450 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 >> v1:172.21.15.57:6789/0 conn(0x7fd7fc140450 legacy=0x7fd7fc0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:48.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80041d0 0x7fd7e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e8004d50 0x7fd7e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0a9230 con 0x7fd7e80041d0 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e800bbf0 con 0x7fd7e8004d50 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e800bdb0 con 0x7fd7fc0add20 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80041d0 0x7fd7e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fa59c700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fad9d700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e8004d50 0x7fd7e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 msgr2=0x7fd7e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7fc0add20 0x7fd7e8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e8004d50 msgr2=0x7fd7e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e8004d50 0x7fd7e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/493917717 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8003570 con 0x7fd7e80041d0 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7fad9d700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e8004d50 0x7fd7e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80041d0 0x7fd7e8004810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40019e0 tx=0x7fd7e4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f54adcb2387e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400c5d0 con 0x7fd7e80041d0 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400c730 con 0x7fd7e80041d0 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.991+0000 7fd7f959a700 1 -- 172.21.15.57:0/493917717 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400cad0 con 0x7fd7e80041d0 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- 172.21.15.57:0/493917717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80041d0 msgr2=0x7fd7e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/493917717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80041d0 0x7fd7e8004810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40019e0 tx=0x7fd7e4007d30 comp rx=0 tx=0).stop 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fad9d700 1 -- 172.21.15.57:0/493917717 reap_dead start 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- 172.21.15.57:0/493917717 shutdown_connections 2023-10-06T03:53:49.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- 172.21.15.57:0/493917717 >> 172.21.15.57:0/493917717 conn(0x7fd7fc067070 msgr2=0x7fd7fc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- 172.21.15.57:0/493917717 shutdown_connections 2023-10-06T03:53:49.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- 172.21.15.57:0/493917717 wait complete. 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 Processor -- start 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.995+0000 7fd7fb59e700 1 -- start start 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 0x7fd7fc142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7fc06d1a0 0x7fd7fc0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc1439e0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc143180 con 0x7fd7fc06d1a0 2023-10-06T03:53:49.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc06c5e0 con 0x7fd7e80041d0 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fa59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 0x7fd7fc142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fad9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7fc06d1a0 0x7fd7fc0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fa59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 0x7fd7fc142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38506/0 (socket says 172.21.15.57:38506) 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46812/0 (socket says 172.21.15.57:46812) 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fa59c700 1 -- 172.21.15.57:0/2010076736 learned_addr learned my addr 172.21.15.57:0/2010076736 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 msgr2=0x7fd7fc142c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 0x7fd7fc142c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7fc06d1a0 msgr2=0x7fd7fc0ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7fc06d1a0 0x7fd7fc0ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 -- 172.21.15.57:0/2010076736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc06baa0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f9d9b700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0a8200 tx=0x7fd7e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400c5d0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e4001360 con 0x7fd7fc06cd30 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc06c8a0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4012d30 con 0x7fd7fc06cd30 2023-10-06T03:53:49.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc06e4f0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:48.999+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc06ca30 con 0x7fd7fc06cd30 2023-10-06T03:53:49.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.003+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd7e4019070 con 0x7fd7fc06cd30 2023-10-06T03:53:49.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.003+0000 7fd7f27fc700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 0x7fd7dc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.003+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7e407d830 con 0x7fd7fc06cd30 2023-10-06T03:53:49.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.003+0000 7fd7fa59c700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 0x7fd7dc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.003+0000 7fd7fa59c700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 0x7fd7dc062a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009e60 tx=0x7fd7ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.011+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd7e404dc20 con 0x7fd7fc06cd30 2023-10-06T03:53:49.177 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.175+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7fc143bf0 con 0x7fd7fc06cd30 2023-10-06T03:53:49.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.175+0000 7fd7f27fc700 1 -- 172.21.15.57:0/2010076736 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fd7e4051240 con 0x7fd7fc06cd30 2023-10-06T03:53:49.179 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:49.179 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 msgr2=0x7fd7dc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 0x7fd7dc062a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009e60 tx=0x7fd7ec008040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 msgr2=0x7fd7fc0abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0a8200 tx=0x7fd7e4015000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 shutdown_connections 2023-10-06T03:53:49.182 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd7dc060580 0x7fd7dc062a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7fc06d1a0 0x7fd7fc0ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7fc06cd30 0x7fd7fc0abb10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 --2- 172.21.15.57:0/2010076736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e80041d0 0x7fd7fc142c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 >> 172.21.15.57:0/2010076736 conn(0x7fd7fc067070 msgr2=0x7fd7fc0af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 shutdown_connections 2023-10-06T03:53:49.183 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.179+0000 7fd7fb59e700 1 -- 172.21.15.57:0/2010076736 wait complete. 2023-10-06T03:53:49.194 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:53:49.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:49.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 Processor -- start 2023-10-06T03:53:49.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- start start 2023-10-06T03:53:49.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f600b2300 0x7f1f6014a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f600b0790 con 0x7f1f600b5b60 2023-10-06T03:53:49.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f600b0a70 con 0x7f1f6014a580 2023-10-06T03:53:49.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600670e0 con 0x7f1f600b2300 2023-10-06T03:53:49.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f600b2300 0x7f1f6014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f600b2300 0x7f1f6014a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46820/0 (socket says 172.21.15.57:46820) 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1481367381 learned_addr learned my addr 172.21.15.57:0/1481367381 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1481367381 >> v1:172.21.15.105:6789/0 conn(0x7f1f6014a580 legacy=0x7f1f60151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1481367381 >> v1:172.21.15.57:6789/0 conn(0x7f1f600b5b60 legacy=0x7f1f600b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1481367381 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600b1130 con 0x7f1f600b2300 2023-10-06T03:53:49.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5ffff700 1 --2- 172.21.15.57:0/1481367381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b2300 0x7f1f6014a040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009fa0 tx=0x7f1f58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694686c8055d020b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5f7fe700 1 -- 172.21.15.57:0/1481367381 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800e070 con 0x7f1f600b2300 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5f7fe700 1 -- 172.21.15.57:0/1481367381 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5800ba80 con 0x7f1f600b2300 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f5f7fe700 1 -- 172.21.15.57:0/1481367381 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f580092e0 con 0x7f1f600b2300 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- 172.21.15.57:0/1481367381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b2300 msgr2=0x7f1f6014a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1481367381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b2300 0x7f1f6014a040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009fa0 tx=0x7f1f58009840 comp rx=0 tx=0).stop 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- 172.21.15.57:0/1481367381 shutdown_connections 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1481367381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b2300 0x7f1f6014a040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.305 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- 172.21.15.57:0/1481367381 >> 172.21.15.57:0/1481367381 conn(0x7f1f60069a70 msgr2=0x7f1f60069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- 172.21.15.57:0/1481367381 shutdown_connections 2023-10-06T03:53:49.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.299+0000 7f1f6700c700 1 -- 172.21.15.57:0/1481367381 wait complete. 2023-10-06T03:53:49.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 Processor -- start 2023-10-06T03:53:49.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 -- start start 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 0x7f1f600a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6014a580 0x7f1f60156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.303+0000 7f1f6700c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600a47d0 con 0x7f1f600b5b60 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f6700c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600a49b0 con 0x7f1f600b2300 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f6700c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600a5920 con 0x7f1f6014a580 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46824/0 (socket says 172.21.15.57:46824) 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1451882805 learned_addr learned my addr 172.21.15.57:0/1451882805 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f64da8700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 0x7f1f600a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f655a9700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6014a580 0x7f1f60156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6014a580 msgr2=0x7f1f60156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6014a580 0x7f1f60156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 msgr2=0x7f1f600a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 0x7f1f600a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 -- 172.21.15.57:0/1451882805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009ae0 con 0x7f1f600b5b60 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f64da8700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 0x7f1f600a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:49.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5ffff700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009880 tx=0x7f1f58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58012b70 con 0x7f1f600b5b60 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58012cf0 con 0x7f1f600b5b60 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f600a5e70 con 0x7f1f600b5b60 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5801d670 con 0x7f1f600b5b60 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f600a5b00 con 0x7f1f600b5b60 2023-10-06T03:53:49.312 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f600a6000 con 0x7f1f600b5b60 2023-10-06T03:53:49.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.307+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1f5801da20 con 0x7f1f600b5b60 2023-10-06T03:53:49.313 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.311+0000 7f1f5cff9700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 0x7f1f40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.311+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1f5807e210 con 0x7f1f600b5b60 2023-10-06T03:53:49.314 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.311+0000 7f1f64da8700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 0x7f1f40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.315 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.311+0000 7f1f64da8700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 0x7f1f40062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001820 tx=0x7f1f48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.319+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f5804e600 con 0x7f1f600b5b60 2023-10-06T03:53:49.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.479+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f6004be00 con 0x7f1f600b5b60 2023-10-06T03:53:49.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f5cff9700 1 -- 172.21.15.57:0/1451882805 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f1f58012e60 con 0x7f1f600b5b60 2023-10-06T03:53:49.487 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:49.487 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 msgr2=0x7f1f40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 0x7f1f40062a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001820 tx=0x7f1f48009040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 msgr2=0x7f1f60156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009880 tx=0x7f1f58017000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 shutdown_connections 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1f40060550 0x7f1f40062a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f6014a580 0x7f1f60156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f600b5b60 0x7f1f60156930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 --2- 172.21.15.57:0/1451882805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f600b2300 0x7f1f600a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.483+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 >> 172.21.15.57:0/1451882805 conn(0x7f1f60069a70 msgr2=0x7f1f60069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.487+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 shutdown_connections 2023-10-06T03:53:49.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.487+0000 7f1f6700c700 1 -- 172.21.15.57:0/1451882805 wait complete. 2023-10-06T03:53:49.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:53:49.502 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:53:49.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:53:49.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:53:49.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:53:49.504 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:53:49.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:53:49.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:53:49.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.643+0000 7f52f135c700 1 Processor -- start 2023-10-06T03:53:49.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.643+0000 7f52f135c700 1 -- start start 2023-10-06T03:53:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52ec06c1f0 0x7f52ec0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52ec068ef0 0x7f52ec13e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec0ab710 con 0x7f52ec0b5020 2023-10-06T03:53:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0ab960 con 0x7f52ec06c1f0 2023-10-06T03:53:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec06e320 con 0x7f52ec068ef0 2023-10-06T03:53:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52ec06c1f0 0x7f52ec0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52ec06c1f0 0x7f52ec0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46828/0 (socket says 172.21.15.57:46828) 2023-10-06T03:53:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 -- 172.21.15.57:0/2654595123 learned_addr learned my addr 172.21.15.57:0/2654595123 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52ea7fc700 1 --2- 172.21.15.57:0/2654595123 >> v2:172.21.15.105:3300/0 conn(0x7f52ec068ef0 0x7f52ec13e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 -- 172.21.15.57:0/2654595123 >> v2:172.21.15.105:3300/0 conn(0x7f52ec068ef0 msgr2=0x7f52ec13e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 --2- 172.21.15.57:0/2654595123 >> v2:172.21.15.105:3300/0 conn(0x7f52ec068ef0 0x7f52ec13e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 -- 172.21.15.57:0/2654595123 >> v1:172.21.15.57:6789/0 conn(0x7f52ec0b5020 legacy=0x7f52ec142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 -- 172.21.15.57:0/2654595123 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec06d710 con 0x7f52ec06c1f0 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52eaffd700 1 --2- 172.21.15.57:0/2654595123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec06c1f0 0x7f52ec0b07f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52ec069630 tx=0x7f52dc00d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91093d84a728f61d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 Processor -- start 2023-10-06T03:53:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52e9ffb700 1 -- 172.21.15.57:0/2654595123 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc012070 con 0x7f52ec06c1f0 2023-10-06T03:53:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 -- start start 2023-10-06T03:53:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52e9ffb700 1 -- 172.21.15.57:0/2654595123 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00fa50 con 0x7f52ec06c1f0 2023-10-06T03:53:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52e9ffb700 1 -- 172.21.15.57:0/2654595123 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00aea0 con 0x7f52ec06c1f0 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 Processor -- start 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 -- start start 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 0x7fe76c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe76c0b1440 0x7fe76c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c0b1dc0 con 0x7fe76c0967d0 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c06d610 con 0x7fe76c0b1440 2023-10-06T03:53:49.653 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772a03700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0b2020 con 0x7fe76c0af050 2023-10-06T03:53:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- 172.21.15.57:0/2654595123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec06c1f0 msgr2=0x7f52ec0b07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 --2- 172.21.15.57:0/2654595123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec06c1f0 0x7f52ec0b07f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f52ec069630 tx=0x7f52dc00d840 comp rx=0 tx=0).stop 2023-10-06T03:53:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771a01700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe76c0967d0 0x7fe76c06cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49418/0 (socket says 172.21.15.57:49418) 2023-10-06T03:53:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771a01700 1 -- 172.21.15.57:0/1536290421 learned_addr learned my addr 172.21.15.57:0/1536290421 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- 172.21.15.57:0/2654595123 shutdown_connections 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 --2- 172.21.15.57:0/2654595123 >> v2:172.21.15.105:3300/0 conn(0x7f52ec068ef0 0x7f52ec13e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 --2- 172.21.15.57:0/2654595123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec06c1f0 0x7f52ec0b07f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- 172.21.15.57:0/2654595123 >> 172.21.15.57:0/2654595123 conn(0x7f52ec067b10 msgr2=0x7f52ec0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771200700 1 --2- 172.21.15.57:0/1536290421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 0x7fe76c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- 172.21.15.57:0/2654595123 shutdown_connections 2023-10-06T03:53:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f52f135c700 1 -- 172.21.15.57:0/2654595123 wait complete. 2023-10-06T03:53:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe7709ff700 1 -- 172.21.15.57:0/1536290421 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165972679 0 0) 0x7fe76c0b1dc0 con 0x7fe76c0967d0 2023-10-06T03:53:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe7709ff700 1 -- 172.21.15.57:0/1536290421 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe758003570 con 0x7fe76c0967d0 2023-10-06T03:53:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f45880b16a0 0x7f4588143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.657 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f3269471700 1 Processor -- start 2023-10-06T03:53:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f3269471700 1 -- start start 2023-10-06T03:53:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458806a640 con 0x7f4588097870 2023-10-06T03:53:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4588069ff0 con 0x7f4588070130 2023-10-06T03:53:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458d188700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458806a2d0 con 0x7f45880b16a0 2023-10-06T03:53:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe772202700 1 --2- 172.21.15.57:0/1536290421 >> v2:172.21.15.57:3300/0 conn(0x7fe76c0b1440 0x7fe76c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4588097870 0x7f45881438d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49422/0 (socket says 172.21.15.57:49422) 2023-10-06T03:53:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7f458659c700 1 -- 172.21.15.57:0/3770984591 learned_addr learned my addr 172.21.15.57:0/3770984591 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771200700 1 -- 172.21.15.57:0/1536290421 >> v2:172.21.15.57:3300/0 conn(0x7fe76c0b1440 msgr2=0x7fe76c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771200700 1 --2- 172.21.15.57:0/1536290421 >> v2:172.21.15.57:3300/0 conn(0x7fe76c0b1440 0x7fe76c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771200700 1 -- 172.21.15.57:0/1536290421 >> v1:172.21.15.57:6789/0 conn(0x7fe76c0967d0 legacy=0x7fe76c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.660 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.647+0000 7fe771200700 1 -- 172.21.15.57:0/1536290421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0af7e0 con 0x7fe76c0af050 2023-10-06T03:53:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 --2- 172.21.15.57:0/3770984591 >> v2:172.21.15.105:3300/0 conn(0x7f45880b16a0 0x7f4588143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905023091 0 0) 0x7f458806a640 con 0x7f4588097870 2023-10-06T03:53:49.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4570003570 con 0x7f4588097870 2023-10-06T03:53:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe771200700 1 --2- 172.21.15.57:0/1536290421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 0x7fe76c0b0f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7680098e0 tx=0x7fe7680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23273aff3c88322 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 386706971 0 0) 0x7f4570003570 con 0x7f4588097870 2023-10-06T03:53:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 >> v2:172.21.15.105:3300/0 conn(0x7f45880b16a0 msgr2=0x7f4588143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 --2- 172.21.15.57:0/3770984591 >> v2:172.21.15.105:3300/0 conn(0x7f45880b16a0 0x7f4588143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 >> v1:172.21.15.105:6789/0 conn(0x7f4588070130 legacy=0x7f4588097160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 Processor -- start 2023-10-06T03:53:49.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880b1b00 con 0x7f4588097870 2023-10-06T03:53:49.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f457c001470 con 0x7f4588097870 2023-10-06T03:53:49.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 -- start start 2023-10-06T03:53:49.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe7709ff700 1 -- 172.21.15.57:0/1536290421 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764001970 con 0x7fe76c0af050 2023-10-06T03:53:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 >> v1:172.21.15.57:6789/0 conn(0x7f4588097870 legacy=0x7f45881438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe7709ff700 1 -- 172.21.15.57:0/1536290421 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768011420 con 0x7fe76c0af050 2023-10-06T03:53:49.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe7709ff700 1 -- 172.21.15.57:0/1536290421 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7680117a0 con 0x7fe76c0af050 2023-10-06T03:53:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4570003a60 0x7f4570003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4570004810 0x7f4570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 0x7f457000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458806a2d0 con 0x7f45700051c0 2023-10-06T03:53:49.666 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 Processor -- start 2023-10-06T03:53:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 0x7f457000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457000c0e0 con 0x7f4570004810 2023-10-06T03:53:49.667 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 -- start start 2023-10-06T03:53:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457000c2a0 con 0x7f4570003a60 2023-10-06T03:53:49.668 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 0x7f52ec0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52ec06c1f0 0x7f52ec0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec0b5020 0x7f52ec0ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec140540 con 0x7f52ec068ef0 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec141800 con 0x7f52ec0b5020 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52f135c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1401f0 con 0x7f52ec06c1f0 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 0x7f52ec0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 0x7f52ec0ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46866/0 (socket says 172.21.15.57:46866) 2023-10-06T03:53:49.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 -- 172.21.15.57:0/4128626664 learned_addr learned my addr 172.21.15.57:0/4128626664 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 -- 172.21.15.57:0/1536290421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 msgr2=0x7fe76c0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 --2- 172.21.15.57:0/1536290421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 0x7fe76c0b0f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7680098e0 tx=0x7fe7680091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eb7fe700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec0b5020 0x7f52ec0ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52ea7fc700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52ec06c1f0 0x7f52ec0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4586d9d700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4570003a60 0x7f4570003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 -- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52ec06c1f0 msgr2=0x7f52ec0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52ec06c1f0 0x7f52ec0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 -- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec0b5020 msgr2=0x7f52ec0ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52ec0b5020 0x7f52ec0ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc00dae0 con 0x7f52ec068ef0 2023-10-06T03:53:49.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 0x7f2cc0093c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cc00af310 0x7f2cc00af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc0095430 con 0x7f2cc00af310 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc00966b0 con 0x7f2cc0093880 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc647f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0096340 con 0x7f2cc00b11e0 2023-10-06T03:53:49.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458659c700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4570004810 0x7f4570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3269471700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32640b6e60 0x7f3264149b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3269471700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f326406c860 0x7f326414a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3269471700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640b2370 con 0x7f32640b18f0 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3269471700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b25c0 con 0x7f32640b6e60 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3269471700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640b28a0 con 0x7f326406c860 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32640b6e60 0x7f3264149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f32640b6e60 0x7f3264149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46868/0 (socket says 172.21.15.57:46868) 2023-10-06T03:53:49.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 -- 172.21.15.57:0/2530060822 learned_addr learned my addr 172.21.15.57:0/2530060822 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 -- 172.21.15.57:0/1536290421 shutdown_connections 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 --2- 172.21.15.57:0/1536290421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0af050 0x7fe76c0b0f00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 --2- 172.21.15.57:0/1536290421 >> v2:172.21.15.57:3300/0 conn(0x7fe76c0b1440 0x7fe76c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 -- 172.21.15.57:0/1536290421 >> 172.21.15.57:0/1536290421 conn(0x7fe76c068840 msgr2=0x7fe76c068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cc00af310 0x7f2cc00af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2cc00af310 0x7f2cc00af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46876/0 (socket says 172.21.15.57:46876) 2023-10-06T03:53:49.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/3310325560 learned_addr learned my addr 172.21.15.57:0/3310325560 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f32627fc700 1 --2- 172.21.15.57:0/2530060822 >> v2:172.21.15.105:3300/0 conn(0x7f326406c860 0x7f326414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 -- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4570003a60 msgr2=0x7f4570003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4570003a60 0x7f4570003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 -- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4570004810 msgr2=0x7f4570004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4570004810 0x7f4570004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 -- 172.21.15.57:0/3770984591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570003570 con 0x7f45700051c0 2023-10-06T03:53:49.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f52eaffd700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 0x7f52ec0ae200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0636a0 tx=0x7f52dc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.678 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 -- 172.21.15.57:0/3770984591 reap_dead start 2023-10-06T03:53:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc5c7e700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4586d9d700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4570003a60 0x7f4570003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 -- 172.21.15.57:0/2530060822 >> v2:172.21.15.105:3300/0 conn(0x7f326406c860 msgr2=0x7f326414a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 --2- 172.21.15.57:0/2530060822 >> v2:172.21.15.105:3300/0 conn(0x7f326406c860 0x7f326414a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 -- 172.21.15.57:0/2530060822 >> v1:172.21.15.105:6789/0 conn(0x7f32640b18f0 legacy=0x7f3264143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 -- 172.21.15.57:0/2530060822 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640b7230 con 0x7f32640b6e60 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc547d700 1 --2- 172.21.15.57:0/3310325560 >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 0x7f2cc0093c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/3310325560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 msgr2=0x7f2cc00b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/3310325560 >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 msgr2=0x7f2cc0093c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/3310325560 >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 0x7f2cc0093c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/3310325560 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00afc50 con 0x7f2cc00af310 2023-10-06T03:53:49.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc547d700 1 --2- 172.21.15.57:0/3310325560 >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 0x7f2cc0093c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:49.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f458759e700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 0x7f457000ba60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f458000e210 tx=0x7f458000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88af908859b7b70f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f3262ffd700 1 --2- 172.21.15.57:0/2530060822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b6e60 0x7f3264149b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f326406d1a0 tx=0x7f325c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36da7caba92cb0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc00af710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00b11b0 tx=0x7f2cbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a69fbd9de83b7c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000eac0 con 0x7f45700051c0 2023-10-06T03:53:49.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458000f040 con 0x7f45700051c0 2023-10-06T03:53:49.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 -- 172.21.15.57:0/1536290421 shutdown_connections 2023-10-06T03:53:49.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7f4585d9b700 1 -- 172.21.15.57:0/3770984591 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000ee70 con 0x7f45700051c0 2023-10-06T03:53:49.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.651+0000 7fe772a03700 1 -- 172.21.15.57:0/1536290421 wait complete. 2023-10-06T03:53:49.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cb7fff700 1 -- 172.21.15.57:0/3310325560 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00b860 con 0x7f2cc00af310 2023-10-06T03:53:49.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cb7fff700 1 -- 172.21.15.57:0/3310325560 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00b9c0 con 0x7f2cc00af310 2023-10-06T03:53:49.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cb7fff700 1 -- 172.21.15.57:0/3310325560 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00bd80 con 0x7f2cc00af310 2023-10-06T03:53:49.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 -- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 msgr2=0x7f457000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 0x7f457000ba60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f458000e210 tx=0x7f458000b040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- 172.21.15.57:0/3310325560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 msgr2=0x7f2cc00af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc00af710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00b11b0 tx=0x7f2cbc009250 comp rx=0 tx=0).stop 2023-10-06T03:53:49.684 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3261ffb700 1 -- 172.21.15.57:0/2530060822 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c00e070 con 0x7f32640b6e60 2023-10-06T03:53:49.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 Processor -- start 2023-10-06T03:53:49.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 -- start start 2023-10-06T03:53:49.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3261ffb700 1 -- 172.21.15.57:0/2530060822 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c00ba50 con 0x7f32640b6e60 2023-10-06T03:53:49.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3261ffb700 1 -- 172.21.15.57:0/2530060822 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0092e0 con 0x7f32640b6e60 2023-10-06T03:53:49.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- 172.21.15.57:0/3310325560 shutdown_connections 2023-10-06T03:53:49.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 --2- 172.21.15.57:0/3310325560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc00af710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 --2- 172.21.15.57:0/3310325560 >> v2:172.21.15.105:3300/0 conn(0x7f2cc0093880 0x7f2cc0093c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- 172.21.15.57:0/3310325560 >> 172.21.15.57:0/3310325560 conn(0x7f2cc0068840 msgr2=0x7f2cc0068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- 172.21.15.57:0/3310325560 shutdown_connections 2023-10-06T03:53:49.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- 172.21.15.57:0/3310325560 wait complete. 2023-10-06T03:53:49.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0967d0 0x7fe76c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 Processor -- start 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 0x7fe76c142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe76c0b1440 0x7fe76c142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c142610 con 0x7fe76c0b1440 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c0aab70 con 0x7fe76c0af050 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772a03700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1422a0 con 0x7fe76c0967d0 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772202700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe76c0b1440 0x7fe76c142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 0x7fe76c142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 -- 172.21.15.57:0/3770984591 shutdown_connections 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 --2- 172.21.15.57:0/3770984591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45700051c0 0x7f457000ba60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 -- 172.21.15.57:0/3770984591 >> 172.21.15.57:0/3770984591 conn(0x7f45880b2830 msgr2=0x7f45880692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 -- 172.21.15.57:0/2530060822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b6e60 msgr2=0x7f3264149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 --2- 172.21.15.57:0/2530060822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b6e60 0x7f3264149b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f326406d1a0 tx=0x7f325c009840 comp rx=0 tx=0).stop 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 -- 172.21.15.57:0/2530060822 shutdown_connections 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 --2- 172.21.15.57:0/2530060822 >> v2:172.21.15.105:3300/0 conn(0x7f326406c860 0x7f326414a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 --2- 172.21.15.57:0/2530060822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b6e60 0x7f3264149b10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 -- 172.21.15.57:0/2530060822 >> 172.21.15.57:0/2530060822 conn(0x7f326406abd0 msgr2=0x7f326406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 0x7fe76c142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50580/0 (socket says 172.21.15.57:50580) 2023-10-06T03:53:49.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe772202700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe76c0b1440 0x7fe76c142fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46878/0 (socket says 172.21.15.57:46878) 2023-10-06T03:53:49.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 -- 172.21.15.57:0/4124508642 learned_addr learned my addr 172.21.15.57:0/4124508642 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771a01700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0967d0 0x7fe76c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00ca00 con 0x7f52ec068ef0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00cb80 con 0x7f52ec068ef0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc02a410 con 0x7f52ec068ef0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52f135c700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec0aeb80 con 0x7f52ec068ef0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52f135c700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec0ae740 con 0x7f52ec068ef0 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 Processor -- start 2023-10-06T03:53:49.691 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fbdcab13700 1 Processor -- start 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 -- start start 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2640b1480 0x7fd264141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd264095780 con 0x7fd264142040 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd264094770 con 0x7fd2640b1480 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd26a043700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640b0a20 con 0x7fd2640961b0 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38556/0 (socket says 172.21.15.57:38556) 2023-10-06T03:53:49.692 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 -- 172.21.15.57:0/1692351084 learned_addr learned my addr 172.21.15.57:0/1692351084 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 -- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0967d0 msgr2=0x7fe76c1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe76c0967d0 0x7fe76c1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 -- 172.21.15.57:0/4124508642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe76c0b1440 msgr2=0x7fe76c142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe76c0b1440 0x7fe76c142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768009420 con 0x7fe76c0af050 2023-10-06T03:53:49.693 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fe771200700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 0x7fe76c142aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0b2160 tx=0x7fe768017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 -- 172.21.15.57:0/3770984591 shutdown_connections 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 -- 172.21.15.57:0/1692351084 >> v2:172.21.15.105:3300/0 conn(0x7fd2640b1480 msgr2=0x7fd264141b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 --2- 172.21.15.57:0/1692351084 >> v2:172.21.15.105:3300/0 conn(0x7fd2640b1480 0x7fd264141b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 -- 172.21.15.57:0/1692351084 >> v1:172.21.15.57:6789/0 conn(0x7fd264142040 legacy=0x7fd264093070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fd269041700 1 -- 172.21.15.57:0/1692351084 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd264096580 con 0x7fd2640961b0 2023-10-06T03:53:49.694 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f458d188700 1 -- 172.21.15.57:0/3770984591 wait complete. 2023-10-06T03:53:49.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f2cc647f700 1 -- start start 2023-10-06T03:53:49.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f52f135c700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52cc000fd0 con 0x7f52ec068ef0 2023-10-06T03:53:49.695 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800bb70 con 0x7fe76c0af050 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd269041700 1 --2- 172.21.15.57:0/1692351084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2600074d0 tx=0x7fd26000ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed953c920b25fe0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 -- 172.21.15.57:0/2530060822 shutdown_connections 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7f3269471700 1 -- 172.21.15.57:0/2530060822 wait complete. 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.655+0000 7fbdcab13700 1 -- start start 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdcab13700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 0x7fbdc40b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdcab13700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc4095780 con 0x7fbdc4142210 2023-10-06T03:53:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdcab13700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc4094770 con 0x7fbdc40b1480 2023-10-06T03:53:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdcab13700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40b0a20 con 0x7fbdc40961b0 2023-10-06T03:53:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800bcd0 con 0x7fe76c0af050 2023-10-06T03:53:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c1572d0 con 0x7fe76c0af050 2023-10-06T03:53:49.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c156a30 con 0x7fe76c0af050 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc9310700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbdc40b1480 0x7fbdc4141b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:42030/0 (socket says 172.21.15.57:42030) 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc9310700 1 -- 172.21.15.57:0/1695881796 learned_addr learned my addr 172.21.15.57:0/1695881796 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 Processor -- start 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cc0093880 0x7f2cc0147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc0097d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00aad50 con 0x7f2cc00af310 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc009a0a0 con 0x7f2cc0093880 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc009a2d0 con 0x7f2cc00b11e0 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 Processor -- start 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- start start 2023-10-06T03:53:49.699 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 -- start start 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 Processor -- start 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd25bfff700 1 -- 172.21.15.57:0/1692351084 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260005ce0 con 0x7fd2640961b0 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd25bfff700 1 -- 172.21.15.57:0/1692351084 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260005e40 con 0x7fd2640961b0 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd25bfff700 1 -- 172.21.15.57:0/1692351084 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000a3e0 con 0x7fd2640961b0 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 -- 172.21.15.57:0/1692351084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 msgr2=0x7fd2640b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 --2- 172.21.15.57:0/1692351084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd2600074d0 tx=0x7fd26000ac50 comp rx=0 tx=0).stop 2023-10-06T03:53:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76801d680 con 0x7fe76c0af050 2023-10-06T03:53:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005728940 0 0) 0x7fbdc4095780 con 0x7fbdc4142210 2023-10-06T03:53:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb0003570 con 0x7fbdc4142210 2023-10-06T03:53:49.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 0x7f32640afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52dc020410 con 0x7f52ec068ef0 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060650 0x7f52d8062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52dc07d850 con 0x7f52ec068ef0 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7f52d8068f00 0x7f52d806b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52d806b9c0 con 0x7f52d8068f00 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52dc082240 con 0x7f52ec068ef0 2023-10-06T03:53:49.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 -- 172.21.15.57:0/1692351084 shutdown_connections 2023-10-06T03:53:49.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 --2- 172.21.15.57:0/1692351084 >> v2:172.21.15.105:3300/0 conn(0x7fd2640b1480 0x7fd264141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 --2- 172.21.15.57:0/1692351084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640b0f40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fd26a043700 1 -- 172.21.15.57:0/1692351084 >> 172.21.15.57:0/1692351084 conn(0x7fd264068840 msgr2=0x7fd264068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32640b6e60 0x7f32640ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc0097d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc5c7e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc0097d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46886/0 (socket says 172.21.15.57:46886) 2023-10-06T03:53:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32640affc0 0x7f32640aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/96672293 learned_addr learned my addr 172.21.15.57:0/96672293 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc547d700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cc0093880 0x7f2cc0147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640b0670 con 0x7f32640b18f0 2023-10-06T03:53:49.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264157130 con 0x7f32640affc0 2023-10-06T03:53:49.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264157410 con 0x7f32640b6e60 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e50068ef0 0x7f6e5006c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 0x7f6e500b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e500ab710 con 0x7f6e5013e440 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e500ab960 con 0x7f6e50068ef0 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5867f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5006e320 con 0x7f6e500b5020 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5641b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e50068ef0 0x7f6e5006c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5641b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6e50068ef0 0x7f6e5006c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46890/0 (socket says 172.21.15.57:46890) 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e5641b700 1 -- 172.21.15.57:0/3955614083 learned_addr learned my addr 172.21.15.57:0/3955614083 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f6e55c1a700 1 --2- 172.21.15.57:0/3955614083 >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 0x7f6e500b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 msgr2=0x7f2cc00a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2cc00b11e0 0x7f2cc00a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cc0093880 msgr2=0x7f2cc0147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2cc0093880 0x7f2cc0147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0094f0 con 0x7f2cc00af310 2023-10-06T03:53:49.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 0x7f32640afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 0x7f32640afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46906/0 (socket says 172.21.15.57:46906) 2023-10-06T03:53:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 -- 172.21.15.57:0/631423851 learned_addr learned my addr 172.21.15.57:0/631423851 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52ea7fc700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060650 0x7f52d8062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc9b11700 1 --2- 172.21.15.57:0/1695881796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 0x7fbdc40b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52eb7fe700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7f52d8068f00 0x7f52d806b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc4c7c700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc0097d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc006fd0 tx=0x7f2cbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe74c000fd0 con 0x7fe76c0af050 2023-10-06T03:53:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 -- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32640b6e60 msgr2=0x7f32640ae680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:53:49.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32640b6e60 0x7f32640ae680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 -- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32640affc0 msgr2=0x7f32640aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc01f070 con 0x7f2cc00af310 2023-10-06T03:53:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc006b80 con 0x7f2cc00af310 2023-10-06T03:53:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc01a670 con 0x7f2cc00af310 2023-10-06T03:53:49.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc0098280 con 0x7f2cc00af310 2023-10-06T03:53:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32640affc0 0x7f32640aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c009ae0 con 0x7f32640b18f0 2023-10-06T03:53:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3262ffd700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 0x7f32640afa80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f326406d1d0 tx=0x7f325c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0099c10 con 0x7f2cc00af310 2023-10-06T03:53:49.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe76801da70 con 0x7fe76c0af050 2023-10-06T03:53:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720604443 0 0) 0x7fbdb0003570 con 0x7fbdc4142210 2023-10-06T03:53:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc9b11700 1 -- 172.21.15.57:0/1695881796 >> v1:172.21.15.105:6789/0 conn(0x7fbdc40b1480 legacy=0x7fbdc4141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f52ea7fc700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060650 0x7f52d8062b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0adca0 tx=0x7f52e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fbdc9b11700 1 -- 172.21.15.57:0/1695881796 >> v1:172.21.15.57:6789/0 conn(0x7fbdc4142210 legacy=0x7fbdc4148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0094e0 con 0x7f32640b18f0 2023-10-06T03:53:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe750060620 0x7fe750062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe76807e1e0 con 0x7fe76c0af050 2023-10-06T03:53:49.713 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe761ffb700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fe750068d60 0x7fe75006b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 -- start start 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45700051c0 0x7f45880996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f458815a800 0x7f4588157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588157770 0x7f45880aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458809b010 con 0x7f458815a800 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458809ada0 con 0x7f45700051c0 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f458d188700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4588156d30 con 0x7f4588157770 2023-10-06T03:53:49.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f4586d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45700051c0 0x7f45880996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe75006b820 con 0x7fe750068d60 2023-10-06T03:53:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe768080780 con 0x7fe76c0af050 2023-10-06T03:53:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe771a01700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe750060620 0x7fe750062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f4586d9d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45700051c0 0x7f45880996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50636/0 (socket says 172.21.15.57:50636) 2023-10-06T03:53:49.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f4586d9d700 1 -- 172.21.15.57:0/1161747352 learned_addr learned my addr 172.21.15.57:0/1161747352 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5641b700 1 -- 172.21.15.57:0/3955614083 >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 msgr2=0x7f6e500b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5641b700 1 --2- 172.21.15.57:0/3955614083 >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 0x7f6e500b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5641b700 1 -- 172.21.15.57:0/3955614083 >> v1:172.21.15.105:6789/0 conn(0x7f6e5013e440 legacy=0x7f6e501419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5641b700 1 -- 172.21.15.57:0/3955614083 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5006d710 con 0x7f6e50068ef0 2023-10-06T03:53:49.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588157770 0x7f45880aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e55c1a700 1 --2- 172.21.15.57:0/3955614083 >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 0x7f6e500b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- 172.21.15.57:0/1692351084 shutdown_connections 2023-10-06T03:53:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- 172.21.15.57:0/1692351084 wait complete. 2023-10-06T03:53:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c008ae0 con 0x7f32640b18f0 2023-10-06T03:53:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c008e80 con 0x7f32640b18f0 2023-10-06T03:53:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32641576f0 con 0x7f32640b18f0 2023-10-06T03:53:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.659+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32641441b0 con 0x7f32640b18f0 2023-10-06T03:53:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5641b700 1 --2- 172.21.15.57:0/3955614083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e50068ef0 0x7f6e5006c1f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006d8a0 tx=0x7f6e4c00fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31468c5cd838dfba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f52eb7fe700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7f52d8068f00 0x7f52d806b310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe772202700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fe750068d60 0x7fe75006b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fbdc9b11700 1 -- 172.21.15.57:0/1695881796 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4096580 con 0x7fbdc40961b0 2023-10-06T03:53:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cc00705e0 con 0x7f2cc00af310 2023-10-06T03:53:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f326406b6e0 con 0x7f32640b18f0 2023-10-06T03:53:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fbdc9b11700 1 --2- 172.21.15.57:0/1695881796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 0x7fbdc40b0f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c050 tx=0x7fbdbc00a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff8024d36de6b7da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2cbc01aa20 con 0x7f2cc00af310 2023-10-06T03:53:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 Processor -- start 2023-10-06T03:53:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- start start 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe771a01700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe750060620 0x7fe750062ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe76400f470 tx=0x7fe764002f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fe772202700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fe750068d60 0x7fe75006b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 -- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45700051c0 msgr2=0x7f45880996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45700051c0 0x7f45880996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 -- 172.21.15.57:0/1161747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f458815a800 msgr2=0x7f4588157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f458815a800 0x7f4588157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588157ba0 con 0x7f4588157770 2023-10-06T03:53:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458759e700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588157770 0x7f45880aeca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f458806a5b0 tx=0x7f4580019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e55419700 1 -- 172.21.15.57:0/3955614083 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c015630 con 0x7f6e50068ef0 2023-10-06T03:53:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e55419700 1 -- 172.21.15.57:0/3955614083 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c0157b0 con 0x7f6e50068ef0 2023-10-06T03:53:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e55419700 1 -- 172.21.15.57:0/3955614083 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c015b70 con 0x7f6e50068ef0 2023-10-06T03:53:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f325c003040 con 0x7f32640b18f0 2023-10-06T03:53:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ca4060520 0x7f2ca40629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2cbc07e490 con 0x7f2cc00af310 2023-10-06T03:53:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2640b1480 0x7fd2640acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f2ca4068dd0 0x7f2ca406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ca406b890 con 0x7f2ca4068dd0 2023-10-06T03:53:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cbc07e860 con 0x7f2cc00af310 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd264142040 0x7fd2640ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640add20 con 0x7fd264142040 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640ac010 con 0x7fd2640b1480 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd26a043700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640abb50 con 0x7fd2640961b0 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000eee0 con 0x7f4588157770 2023-10-06T03:53:49.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580022070 con 0x7f4588157770 2023-10-06T03:53:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458001d870 con 0x7f4588157770 2023-10-06T03:53:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00f070 con 0x7fbdc40961b0 2023-10-06T03:53:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458815adb0 con 0x7f4588157770 2023-10-06T03:53:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3250060620 0x7f3250062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd268840700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2640b1480 0x7fd2640acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd268840700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2640b1480 0x7fd2640acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50644/0 (socket says 172.21.15.57:50644) 2023-10-06T03:53:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd268840700 1 -- 172.21.15.57:0/3626317047 learned_addr learned my addr 172.21.15.57:0/3626317047 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4588099c00 con 0x7f4588157770 2023-10-06T03:53:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00a0d0 con 0x7fbdc40961b0 2023-10-06T03:53:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fbdc8b0f700 1 -- 172.21.15.57:0/1695881796 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4001470 con 0x7fbdc40961b0 2023-10-06T03:53:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cc5c7e700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f2ca4068dd0 0x7f2ca406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7fd269041700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f325c07e450 con 0x7f32640b18f0 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f32627fc700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3250060620 0x7f3250062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f3250068d60 0x7f325006b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f325006b820 con 0x7f3250068d60 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f325c0809b0 con 0x7f32640b18f0 2023-10-06T03:53:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f32637fe700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f3250068d60 0x7f325006b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f2cc5c7e700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f2ca4068dd0 0x7f2ca406b1e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5867f700 1 -- 172.21.15.57:0/3955614083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e50068ef0 msgr2=0x7f6e5006c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f6e5867f700 1 --2- 172.21.15.57:0/3955614083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e50068ef0 0x7f6e5006c1f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006d8a0 tx=0x7f6e4c00fa80 comp rx=0 tx=0).stop 2023-10-06T03:53:49.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f2cc547d700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ca4060520 0x7f2ca40629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 -- 172.21.15.57:0/3955614083 shutdown_connections 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 --2- 172.21.15.57:0/3955614083 >> v2:172.21.15.105:3300/0 conn(0x7f6e500b5020 0x7f6e500b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 --2- 172.21.15.57:0/3955614083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e50068ef0 0x7f6e5006c1f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 -- 172.21.15.57:0/3955614083 >> 172.21.15.57:0/3955614083 conn(0x7f6e50067b10 msgr2=0x7f6e500b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- 172.21.15.57:0/1695881796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 msgr2=0x7fbdc40b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 --2- 172.21.15.57:0/1695881796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 0x7fbdc40b0f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00c050 tx=0x7fbdbc00a890 comp rx=0 tx=0).stop 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 -- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2640b1480 msgr2=0x7fd2640acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2640b1480 0x7fd2640acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 -- 172.21.15.57:0/3626317047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd264142040 msgr2=0x7fd2640ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd264142040 0x7fd2640ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260007040 con 0x7fd2640961b0 2023-10-06T03:53:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== osd.6 v2:172.21.15.105:6800/33625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe75006b820 con 0x7fe750068d60 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 -- 172.21.15.57:0/3955614083 shutdown_connections 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 -- 172.21.15.57:0/3955614083 wait complete. 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- 172.21.15.57:0/1695881796 shutdown_connections 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 --2- 172.21.15.57:0/1695881796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40961b0 0x7fbdc40b0f40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- 172.21.15.57:0/1695881796 >> 172.21.15.57:0/1695881796 conn(0x7fbdc4068840 msgr2=0x7fbdc4068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- 172.21.15.57:0/1695881796 shutdown_connections 2023-10-06T03:53:49.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd269041700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640ae0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd260015000 tx=0x7fd260016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f458804be00 con 0x7f4588157770 2023-10-06T03:53:49.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f32637fe700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f3250068d60 0x7f325006b170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260022070 con 0x7fd2640961b0 2023-10-06T03:53:49.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2640aac60 con 0x7fd2640961b0 2023-10-06T03:53:49.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2640ae7b0 con 0x7fd2640961b0 2023-10-06T03:53:49.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260006760 con 0x7fd2640961b0 2023-10-06T03:53:49.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000f070 con 0x7fd2640961b0 2023-10-06T03:53:49.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4580003020 con 0x7f4588157770 2023-10-06T03:53:49.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- 172.21.15.57:0/1695881796 wait complete. 2023-10-06T03:53:49.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 Processor -- start 2023-10-06T03:53:49.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 Processor -- start 2023-10-06T03:53:49.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== osd.4 v2:172.21.15.105:6804/33626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2ca406b890 con 0x7f2ca4068dd0 2023-10-06T03:53:49.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7f6e5867f700 1 -- start start 2023-10-06T03:53:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- start start 2023-10-06T03:53:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 0x7fbdc406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40b1480 0x7fbdc40906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc4142210 0x7fbdc4090c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41594f0 con 0x7fbdc40961b0 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc4090240 con 0x7fbdc4142210 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdcab13700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc4091d00 con 0x7fbdc40b1480 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 0x7fbdc406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdca312700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc4142210 0x7fbdc4090c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 0x7fbdc406e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46922/0 (socket says 172.21.15.57:46922) 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 -- 172.21.15.57:0/3349243573 learned_addr learned my addr 172.21.15.57:0/3349243573 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9310700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40b1480 0x7fbdc40906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 -- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40b1480 msgr2=0x7fbdc40906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc40b1480 0x7fbdc40906d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 -- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc4142210 msgr2=0x7fbdc4090c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc4142210 0x7fbdc4090c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.667+0000 7fbdc9b11700 1 -- 172.21.15.57:0/3349243573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc00ab30 con 0x7fbdc40961b0 2023-10-06T03:53:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== osd.0 v2:172.21.15.57:6816/33351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f325006b820 con 0x7f3250068d60 2023-10-06T03:53:49.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fbdc9b11700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 0x7fbdc406e290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406a910 tx=0x7fbdbc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e50068ef0 0x7f6e5013b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 0x7f6e5013ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5013e440 0x7f6e501431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501414f0 con 0x7f6e500b5020 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5013fe90 con 0x7f6e50068ef0 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50137b00 con 0x7f6e5013e440 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 0x7f6e5013ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 0x7f6e5013ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46930/0 (socket says 172.21.15.57:46930) 2023-10-06T03:53:49.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 -- 172.21.15.57:0/1598383350 learned_addr learned my addr 172.21.15.57:0/1598383350 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4574060550 0x7f4574062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f2cc547d700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ca4060520 0x7f2ca40629d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800d650 tx=0x7f2cb8007800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd244000fd0 con 0x7fd2640961b0 2023-10-06T03:53:49.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f32627fc700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3250060620 0x7f3250062ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32641579d0 tx=0x7f3258008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5641b700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e50068ef0 0x7f6e5013b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4580024070 con 0x7f4588157770 2023-10-06T03:53:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f4586d9d700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4574060550 0x7f4574062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f4574068e00 0x7f457406b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd260012960 con 0x7fd2640961b0 2023-10-06T03:53:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f457406b8c0 con 0x7f4574068e00 2023-10-06T03:53:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f458007efd0 con 0x7f4588157770 2023-10-06T03:53:49.744 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 -- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5013e440 msgr2=0x7f6e501431a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e5013e440 0x7f6e501431a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 -- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e50068ef0 msgr2=0x7f6e5013b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e50068ef0 0x7f6e5013b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009a20 con 0x7f6e500b5020 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f458659c700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f4574068e00 0x7f457406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e55c1a700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 0x7f6e5013ba70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800c1a0 tx=0x7f6e4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800cd90 con 0x7f6e500b5020 2023-10-06T03:53:49.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f4586d9d700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4574060550 0x7f4574062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4578001370 tx=0x7f4578009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c00fd20 con 0x7f6e500b5020 2023-10-06T03:53:49.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd248060550 0x7fd248062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e50140080 con 0x7f6e500b5020 2023-10-06T03:53:49.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd268840700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd248060550 0x7fd248062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f458659c700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f4574068e00 0x7f457406b210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd26007da90 con 0x7fd2640961b0 2023-10-06T03:53:49.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7fd248068c90 0x7fd24806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd24806b750 con 0x7fd248068c90 2023-10-06T03:53:49.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd260082220 con 0x7fd2640961b0 2023-10-06T03:53:49.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800f040 con 0x7f6e500b5020 2023-10-06T03:53:49.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e480146b0 con 0x7f6e500b5020 2023-10-06T03:53:49.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e5004be00 con 0x7f6e500b5020 2023-10-06T03:53:49.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== osd.7 v2:172.21.15.105:6816/33627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f457406b8c0 con 0x7f4574068e00 2023-10-06T03:53:49.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6e48014a20 con 0x7f6e500b5020 2023-10-06T03:53:49.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd268840700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd248060550 0x7fd248062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2640a7f40 tx=0x7fd2540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7fd269842700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7fd248068c90 0x7fd24806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6e34060620 0x7f6e34062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.671+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e4807d630 con 0x7f6e500b5020 2023-10-06T03:53:49.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.663+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== osd.2 v2:172.21.15.57:6808/33347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f52d806b9c0 con 0x7f52d8068f00 2023-10-06T03:53:49.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e5641b700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6e34060620 0x7f6e34062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e467fc700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7f6e34068ed0 0x7f6e3406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e3406b990 con 0x7f6e34068ed0 2023-10-06T03:53:49.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e4807fc70 con 0x7f6e500b5020 2023-10-06T03:53:49.751 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e56c1c700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7f6e34068ed0 0x7f6e3406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7fd269842700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7fd248068c90 0x7fd24806b0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e5641b700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6e34060620 0x7f6e34062ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006d8a0 tx=0x7f6e4c01e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e56c1c700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7f6e34068ed0 0x7f6e3406b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== osd.5 v2:172.21.15.105:6824/33628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd24806b750 con 0x7fd248068c90 2023-10-06T03:53:49.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.675+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== osd.1 v2:172.21.15.57:6818/33352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6e3406b990 con 0x7f6e34068ed0 2023-10-06T03:53:49.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc00a530 con 0x7fbdc40961b0 2023-10-06T03:53:49.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc008660 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc008a20 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc409a730 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc4091960 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbdbc01a070 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbda80606a0 0x7fbda8062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.679+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbdbc07d9a0 con 0x7fbdc40961b0 2023-10-06T03:53:49.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7f52f135c700 1 -- 172.21.15.57:0/4128626664 --> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f52cc002d30 con 0x7f52d8068f00 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.687+0000 7fbdc9310700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbda80606a0 0x7fbda8062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.687+0000 7fbdc9310700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbda80606a0 0x7fbda8062b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbdc409a240 tx=0x7fbdc000a2e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7fbdcab13700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7fbda40015f0 0x7fbda4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 --> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbda4006b90 con 0x7fbda40015f0 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7fbdca312700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7fbda40015f0 0x7fbda4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7f52d2ffd700 1 -- 172.21.15.57:0/4128626664 <== osd.2 v2:172.21.15.57:6808/33347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f52cc002d30 con 0x7f52d8068f00 2023-10-06T03:53:49.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7fbdca312700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7fbda40015f0 0x7fbda4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.691+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== osd.3 v2:172.21.15.57:6800/33348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbda4006b90 con 0x7fbda40015f0 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7f52d8068f00 msgr2=0x7f52d806b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7f52d8068f00 0x7f52d806b310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060650 msgr2=0x7f52d8062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060650 0x7f52d8062b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0adca0 tx=0x7f52e0008040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 msgr2=0x7f52ec0ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 --2- 172.21.15.57:0/4128626664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52ec068ef0 0x7f52ec0ae200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0636a0 tx=0x7f52dc01c000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52eb7fe700 1 -- 172.21.15.57:0/4128626664 reap_dead start 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 shutdown_connections 2023-10-06T03:53:49.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 >> 172.21.15.57:0/4128626664 conn(0x7f52ec067b10 msgr2=0x7f52ec0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 --> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2cc0093430 con 0x7f2ca4068dd0 2023-10-06T03:53:49.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 shutdown_connections 2023-10-06T03:53:49.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 --> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4588156e70 con 0x7f4574068e00 2023-10-06T03:53:49.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f52d0ff9700 1 -- 172.21.15.57:0/4128626664 wait complete. 2023-10-06T03:53:49.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 --> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe74c002d30 con 0x7fe750068d60 2023-10-06T03:53:49.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f2cb57fa700 1 -- 172.21.15.57:0/96672293 <== osd.4 v2:172.21.15.105:6804/33626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2cc0093430 con 0x7f2ca4068dd0 2023-10-06T03:53:49.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe761ffb700 1 -- 172.21.15.57:0/4124508642 <== osd.6 v2:172.21.15.105:6800/33625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe74c002d30 con 0x7fe750068d60 2023-10-06T03:53:49.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f456effd700 1 -- 172.21.15.57:0/1161747352 <== osd.7 v2:172.21.15.105:6816/33627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f457c00e040 con 0x7f4574068e00 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f4574068e00 msgr2=0x7f457406b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f4574068e00 0x7f457406b210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4574060550 msgr2=0x7f4574062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4574060550 0x7f4574062a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4578001370 tx=0x7f4578009040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588157770 msgr2=0x7f45880aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 --2- 172.21.15.57:0/1161747352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588157770 0x7f45880aeca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f458806a5b0 tx=0x7f4580019000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fe750068d60 msgr2=0x7fe75006b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fe750068d60 0x7fe75006b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458759e700 1 -- 172.21.15.57:0/1161747352 reap_dead start 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe750060620 msgr2=0x7fe750062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe750060620 0x7fe750062ad0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe76400f470 tx=0x7fe764002f10 comp rx=0 tx=0).stop 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 msgr2=0x7fe76c142aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 --2- 172.21.15.57:0/4124508642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe76c0af050 0x7fe76c142aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0b2160 tx=0x7fe768017000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772202700 1 -- 172.21.15.57:0/4124508642 reap_dead start 2023-10-06T03:53:49.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 shutdown_connections 2023-10-06T03:53:49.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 >> 172.21.15.57:0/1161747352 conn(0x7f45880b2830 msgr2=0x7f45881403f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 shutdown_connections 2023-10-06T03:53:49.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 >> 172.21.15.57:0/4124508642 conn(0x7fe76c068840 msgr2=0x7fe76c068c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 shutdown_connections 2023-10-06T03:53:49.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7f458d188700 1 -- 172.21.15.57:0/1161747352 wait complete. 2023-10-06T03:53:49.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 shutdown_connections 2023-10-06T03:53:49.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.695+0000 7fe772a03700 1 -- 172.21.15.57:0/4124508642 wait complete. 2023-10-06T03:53:49.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 --> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f32640b5830 con 0x7f3250068d60 2023-10-06T03:53:49.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f2ca4068dd0 msgr2=0x7f2ca406b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f2ca4068dd0 0x7f2ca406b1e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ca4060520 msgr2=0x7f2ca40629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2ca4060520 0x7f2ca40629d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800d650 tx=0x7f2cb8007800 comp rx=0 tx=0).stop 2023-10-06T03:53:49.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 msgr2=0x7f2cc0097d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 --2- 172.21.15.57:0/96672293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2cc00af310 0x7f2cc0097d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc006fd0 tx=0x7f2cbc017000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc5c7e700 1 -- 172.21.15.57:0/96672293 reap_dead start 2023-10-06T03:53:49.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f324affd700 1 -- 172.21.15.57:0/631423851 <== osd.0 v2:172.21.15.57:6816/33351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f32640b5830 con 0x7f3250068d60 2023-10-06T03:53:49.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 shutdown_connections 2023-10-06T03:53:49.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 >> 172.21.15.57:0/96672293 conn(0x7f2cc0068840 msgr2=0x7f2cc0093c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 shutdown_connections 2023-10-06T03:53:49.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f2cc647f700 1 -- 172.21.15.57:0/96672293 wait complete. 2023-10-06T03:53:49.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f3250068d60 msgr2=0x7f325006b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f3250068d60 0x7f325006b170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3250060620 msgr2=0x7f3250062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3250060620 0x7f3250062ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f32641579d0 tx=0x7f3258008040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 msgr2=0x7f32640afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 --2- 172.21.15.57:0/631423851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32640b18f0 0x7f32640afa80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f326406d1d0 tx=0x7f325c018000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f32637fe700 1 -- 172.21.15.57:0/631423851 reap_dead start 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 shutdown_connections 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 >> 172.21.15.57:0/631423851 conn(0x7f326406abd0 msgr2=0x7f3264068fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 shutdown_connections 2023-10-06T03:53:49.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.699+0000 7f3269471700 1 -- 172.21.15.57:0/631423851 wait complete. 2023-10-06T03:53:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.703+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 --> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd244002d30 con 0x7fd248068c90 2023-10-06T03:53:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.703+0000 7fd2597fa700 1 -- 172.21.15.57:0/3626317047 <== osd.5 v2:172.21.15.105:6824/33628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd244002d30 con 0x7fd248068c90 2023-10-06T03:53:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.711+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 --> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e5006d430 con 0x7f6e34068ed0 2023-10-06T03:53:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.711+0000 7f6e467fc700 1 -- 172.21.15.57:0/1598383350 <== osd.1 v2:172.21.15.57:6818/33352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e5006d430 con 0x7f6e34068ed0 2023-10-06T03:53:49.771 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:49.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:53:49.772 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7fd248068c90 msgr2=0x7fd24806b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7fd248068c90 0x7fd24806b0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd248060550 msgr2=0x7fd248062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd248060550 0x7fd248062a00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2640a7f40 tx=0x7fd2540091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 msgr2=0x7fd2640ae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 --2- 172.21.15.57:0/3626317047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2640961b0 0x7fd2640ae0a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd260015000 tx=0x7fd260016000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd269842700 1 -- 172.21.15.57:0/3626317047 reap_dead start 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 shutdown_connections 2023-10-06T03:53:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 >> 172.21.15.57:0/3626317047 conn(0x7fd264068840 msgr2=0x7fd2640b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.774 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:49.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:53:49.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7f6e34068ed0 msgr2=0x7f6e3406b2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7f6e34068ed0 0x7f6e3406b2e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 shutdown_connections 2023-10-06T03:53:49.775 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7fd26a043700 1 -- 172.21.15.57:0/3626317047 wait complete. 2023-10-06T03:53:49.776 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:49.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6e34060620 msgr2=0x7f6e34062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6e34060620 0x7f6e34062ad0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6e5006d8a0 tx=0x7f6e4c01e000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 msgr2=0x7f6e5013ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 --2- 172.21.15.57:0/1598383350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6e500b5020 0x7f6e5013ba70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e4800c1a0 tx=0x7f6e4800b040 comp rx=0 tx=0).stop 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e56c1c700 1 -- 172.21.15.57:0/1598383350 reap_dead start 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 shutdown_connections 2023-10-06T03:53:49.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 >> 172.21.15.57:0/1598383350 conn(0x7f6e50067b10 msgr2=0x7f6e5013d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 shutdown_connections 2023-10-06T03:53:49.778 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.715+0000 7f6e5867f700 1 -- 172.21.15.57:0/1598383350 wait complete. 2023-10-06T03:53:49.778 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:49.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:53:49.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 --> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbda4005c80 con 0x7fbda40015f0 2023-10-06T03:53:49.779 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdb9ffb700 1 -- 172.21.15.57:0/3349243573 <== osd.3 v2:172.21.15.57:6800/33348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbda4005c80 con 0x7fbda40015f0 2023-10-06T03:53:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7fbda40015f0 msgr2=0x7fbda4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7fbda40015f0 0x7fbda4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbda80606a0 msgr2=0x7fbda8062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbda80606a0 0x7fbda8062b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbdc409a240 tx=0x7fbdc000a2e0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.780 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 msgr2=0x7fbdc406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 --2- 172.21.15.57:0/3349243573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc40961b0 0x7fbdc406e290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbdc406a910 tx=0x7fbdbc018000 comp rx=0 tx=0).stop 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdca312700 1 -- 172.21.15.57:0/3349243573 reap_dead start 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 shutdown_connections 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 >> 172.21.15.57:0/3349243573 conn(0x7fbdc4068840 msgr2=0x7fbdc40b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.719+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 shutdown_connections 2023-10-06T03:53:49.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.723+0000 7fbdcab13700 1 -- 172.21.15.57:0/3349243573 wait complete. 2023-10-06T03:53:49.782 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-10-06T03:53:49.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:53:49.783 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-10-06T03:53:49.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:53:49.784 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:49.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:53:49.785 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:49.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:53:49.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 Processor -- start 2023-10-06T03:53:49.957 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 -- start start 2023-10-06T03:53:49.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 Processor -- start 2023-10-06T03:53:49.958 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 -- start start 2023-10-06T03:53:49.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 0x7f28740afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740b1990 con 0x7f28740af050 2023-10-06T03:53:49.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f28740af050 0x7f28740b06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49438/0 (socket says 172.21.15.57:49438) 2023-10-06T03:53:49.959 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287259c700 1 -- 172.21.15.57:0/4046494592 learned_addr learned my addr 172.21.15.57:0/4046494592 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f2871d9b700 1 --2- 172.21.15.57:0/4046494592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 0x7f28740afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28740affa0 con 0x7f28740af420 2023-10-06T03:53:49.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2874098fd0 con 0x7f2874097650 2023-10-06T03:53:49.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1dc0b5250 0x7ff1dc13f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.960 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080927287 0 0) 0x7f28740b1990 con 0x7f28740af050 2023-10-06T03:53:49.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1dc0b5250 0x7ff1dc13f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1dc0b5250 0x7ff1dc13f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46932/0 (socket says 172.21.15.57:46932) 2023-10-06T03:53:49.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 -- 172.21.15.57:0/2926740880 learned_addr learned my addr 172.21.15.57:0/2926740880 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.961 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 --2- 172.21.15.57:0/2926740880 >> v2:172.21.15.105:3300/0 conn(0x7ff1dc0ae420 0x7ff1dc06c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc1400a0 con 0x7ff1dc06bdb0 2023-10-06T03:53:49.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc139960 con 0x7ff1dc0b5250 2023-10-06T03:53:49.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc06cf10 con 0x7ff1dc0ae420 2023-10-06T03:53:49.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f285c003570 con 0x7f28740af050 2023-10-06T03:53:49.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593857716 0 0) 0x7f28740affa0 con 0x7f28740af420 2023-10-06T03:53:49.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28740b1990 con 0x7f28740af420 2023-10-06T03:53:49.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f2871d9b700 1 -- 172.21.15.57:0/4046494592 >> v1:172.21.15.105:6789/0 conn(0x7f28740af420 legacy=0x7f28740b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f2871d9b700 1 -- 172.21.15.57:0/4046494592 >> v1:172.21.15.57:6789/0 conn(0x7f28740af050 legacy=0x7f28740b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f2871d9b700 1 -- 172.21.15.57:0/4046494592 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874099900 con 0x7f2874097650 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1db7fe700 1 --2- 172.21.15.57:0/2926740880 >> v2:172.21.15.105:3300/0 conn(0x7ff1dc0ae420 0x7ff1dc06c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 -- 172.21.15.57:0/2926740880 >> v2:172.21.15.105:3300/0 conn(0x7ff1dc0ae420 msgr2=0x7ff1dc06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 --2- 172.21.15.57:0/2926740880 >> v2:172.21.15.105:3300/0 conn(0x7ff1dc0ae420 0x7ff1dc06c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 -- 172.21.15.57:0/2926740880 >> v1:172.21.15.105:6789/0 conn(0x7ff1dc06bdb0 legacy=0x7ff1dc0add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 -- 172.21.15.57:0/2926740880 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc06e3f0 con 0x7ff1dc0b5250 2023-10-06T03:53:49.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7ff1daffd700 1 --2- 172.21.15.57:0/2926740880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc13f140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b0a80 tx=0x7ff1d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef94d0e2e7ec5281 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f2871d9b700 1 --2- 172.21.15.57:0/4046494592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 0x7f28740afa60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f286800aaf0 tx=0x7f286800a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9bf1b4a7c3893c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2864001470 con 0x7f2874097650 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800c660 con 0x7f2874097650 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.955+0000 7f287159a700 1 -- 172.21.15.57:0/4046494592 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800ca00 con 0x7f2874097650 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 msgr2=0x7f28740afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 --2- 172.21.15.57:0/4046494592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 0x7f28740afa60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f286800aaf0 tx=0x7f286800a330 comp rx=0 tx=0).stop 2023-10-06T03:53:49.966 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1d9ffb700 1 -- 172.21.15.57:0/2926740880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400e070 con 0x7ff1dc0b5250 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1d9ffb700 1 -- 172.21.15.57:0/2926740880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400ba10 con 0x7ff1dc0b5250 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1d9ffb700 1 -- 172.21.15.57:0/2926740880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40092e0 con 0x7ff1dc0b5250 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0b5250 msgr2=0x7ff1dc13f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 --2- 172.21.15.57:0/2926740880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc13f140 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b0a80 tx=0x7ff1d4009840 comp rx=0 tx=0).stop 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 shutdown_connections 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 --2- 172.21.15.57:0/2926740880 >> v2:172.21.15.105:3300/0 conn(0x7ff1dc0ae420 0x7ff1dc06c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 --2- 172.21.15.57:0/2926740880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc13f140 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 >> 172.21.15.57:0/2926740880 conn(0x7ff1dc067b40 msgr2=0x7ff1dc0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 shutdown_connections 2023-10-06T03:53:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7ff1e161e700 1 -- 172.21.15.57:0/2926740880 wait complete. 2023-10-06T03:53:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 shutdown_connections 2023-10-06T03:53:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 --2- 172.21.15.57:0/4046494592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2874097650 0x7f28740afa60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 >> 172.21.15.57:0/4046494592 conn(0x7f287409a040 msgr2=0x7f2874068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 shutdown_connections 2023-10-06T03:53:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7f287359e700 1 -- 172.21.15.57:0/4046494592 wait complete. 2023-10-06T03:53:49.969 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7fbca10da700 1 Processor -- start 2023-10-06T03:53:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7fb58d9b1700 1 Processor -- start 2023-10-06T03:53:49.970 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7fbca10da700 1 -- start start 2023-10-06T03:53:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.959+0000 7fb58d9b1700 1 -- start start 2023-10-06T03:53:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca10da700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc9c093880 0x7fbc9c093c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 Processor -- start 2023-10-06T03:53:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 -- start start 2023-10-06T03:53:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 Processor -- start 2023-10-06T03:53:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca10da700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 0x7fbc9c1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58d9b1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58d9b1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb58806cf00 0x7fb58806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca10da700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c0966b0 con 0x7fbc9c0af310 2023-10-06T03:53:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca10da700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c095430 con 0x7fbc9c093880 2023-10-06T03:53:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca10da700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c096340 con 0x7fbc9c145cc0 2023-10-06T03:53:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58d9b1700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880af590 con 0x7fb5880a6d40 2023-10-06T03:53:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58d9b1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880b2020 con 0x7fb58806cf00 2023-10-06T03:53:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58d9b1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880af7e0 con 0x7fb5880967d0 2023-10-06T03:53:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 -- start start 2023-10-06T03:53:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5aa00b03e0 0x7f5aa0152090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.976 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38622/0 (socket says 172.21.15.57:38622) 2023-10-06T03:53:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 -- 172.21.15.57:0/2714312215 learned_addr learned my addr 172.21.15.57:0/2714312215 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa006e510 con 0x7f5aa006da50 2023-10-06T03:53:49.977 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa006d2e0 con 0x7f5aa00b5250 2023-10-06T03:53:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa7b67700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa006dec0 con 0x7f5aa00b03e0 2023-10-06T03:53:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa5102700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5aa006da50 0x7f5aa00afcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49448/0 (socket says 172.21.15.57:49448) 2023-10-06T03:53:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa5102700 1 -- 172.21.15.57:0/3932593725 learned_addr learned my addr 172.21.15.57:0/3932593725 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa6104700 1 --2- 172.21.15.57:0/3932593725 >> v2:172.21.15.57:3300/0 conn(0x7f5aa00b03e0 0x7f5aa0152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.978 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa4901700 1 -- 172.21.15.57:0/3932593725 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774505796 0 0) 0x7f5aa006e510 con 0x7f5aa006da50 2023-10-06T03:53:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 Processor -- start 2023-10-06T03:53:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc9c093880 0x7fbc9c093c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbc9c093880 0x7fbc9c093c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46944/0 (socket says 172.21.15.57:46944) 2023-10-06T03:53:49.979 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 -- 172.21.15.57:0/726628310 learned_addr learned my addr 172.21.15.57:0/726628310 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca08d9700 1 --2- 172.21.15.57:0/726628310 >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 0x7fbc9c1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 -- 172.21.15.57:0/2714312215 >> v2:172.21.15.105:3300/0 conn(0x7fb58806cf00 msgr2=0x7fb58806d2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:53:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 --2- 172.21.15.57:0/2714312215 >> v2:172.21.15.105:3300/0 conn(0x7fb58806cf00 0x7fb58806d2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 -- 172.21.15.57:0/2714312215 >> v1:172.21.15.105:6789/0 conn(0x7fb5880a6d40 legacy=0x7fb5880a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 -- 172.21.15.57:0/2714312215 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5880afac0 con 0x7fb5880967d0 2023-10-06T03:53:49.981 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa4901700 1 -- 172.21.15.57:0/3932593725 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c003570 con 0x7f5aa006da50 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1dc06bdb0 0x7ff1dc0a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 0x7ff1dc13c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0a84a0 con 0x7ff1dc0ae420 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc13c5f0 con 0x7ff1dc0b5250 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1e161e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0a7ad0 con 0x7ff1dc06bdb0 2023-10-06T03:53:49.982 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 -- start start 2023-10-06T03:53:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa6104700 1 -- 172.21.15.57:0/3932593725 >> v1:172.21.15.105:6789/0 conn(0x7f5aa00b5250 legacy=0x7f5aa0140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa6104700 1 -- 172.21.15.57:0/3932593725 >> v1:172.21.15.57:6789/0 conn(0x7f5aa006da50 legacy=0x7f5aa00afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa6104700 1 -- 172.21.15.57:0/3932593725 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa006e1a0 con 0x7f5aa00b03e0 2023-10-06T03:53:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 -- 172.21.15.57:0/726628310 >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 msgr2=0x7fbc9c1460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:49.983 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 --2- 172.21.15.57:0/726628310 >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 0x7fbc9c1460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 -- 172.21.15.57:0/726628310 >> v1:172.21.15.105:6789/0 conn(0x7fbc9c0af310 legacy=0x7fbc9c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 -- 172.21.15.57:0/726628310 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c096010 con 0x7fbc9c093880 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb58c9af700 1 --2- 172.21.15.57:0/2714312215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb578009990 tx=0x7fb578009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3415b6d12ad48423 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1db7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1db7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50714/0 (socket says 172.21.15.57:50714) 2023-10-06T03:53:49.984 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1db7fe700 1 -- 172.21.15.57:0/172106096 learned_addr learned my addr 172.21.15.57:0/172106096 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1daffd700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1dc06bdb0 0x7ff1dc0a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 0x7ff1dc13c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa6104700 1 --2- 172.21.15.57:0/3932593725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0152090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a900098e0 tx=0x7f5a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03691de5c6dc7c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.985 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbca08d9700 1 --2- 172.21.15.57:0/726628310 >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 0x7fbc9c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9bfff700 1 --2- 172.21.15.57:0/726628310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c093880 0x7fbc9c093c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c06ba00 tx=0x7fbc8c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de127879a500b58c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2874097650 0x7f28740b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa4901700 1 -- 172.21.15.57:0/3932593725 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90011630 con 0x7f5aa00b03e0 2023-10-06T03:53:49.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f5aa4901700 1 -- 172.21.15.57:0/3932593725 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90011790 con 0x7f5aa00b03e0 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 -- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1dc06bdb0 msgr2=0x7ff1dc0a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1dc06bdb0 0x7ff1dc0a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 -- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 msgr2=0x7ff1dc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 -- 172.21.15.57:0/172106096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009ae0 con 0x7ff1dc0ae420 2023-10-06T03:53:49.987 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28740af420 0x7f2874141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb5877fe700 1 -- 172.21.15.57:0/2714312215 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578005c10 con 0x7fb5880967d0 2023-10-06T03:53:49.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fb5877fe700 1 -- 172.21.15.57:0/2714312215 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578005d70 con 0x7fb5880967d0 2023-10-06T03:53:49.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1db7fe700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740a7b70 con 0x7f28740af420 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28740b3470 con 0x7f2874097650 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28741413e0 con 0x7f28740af050 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9affd700 1 -- 172.21.15.57:0/726628310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c005c10 con 0x7fbc9c093880 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9affd700 1 -- 172.21.15.57:0/726628310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c005d70 con 0x7fbc9c093880 2023-10-06T03:53:49.989 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7fbc9affd700 1 -- 172.21.15.57:0/726628310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c00b8a0 con 0x7fbc9c093880 2023-10-06T03:53:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7ff1da7fc700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 0x7ff1dc13c0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0010940 tx=0x7ff1d0002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f2871d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f2871d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38646/0 (socket says 172.21.15.57:38646) 2023-10-06T03:53:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f2871d9b700 1 -- 172.21.15.57:0/4040180510 learned_addr learned my addr 172.21.15.57:0/4040180510 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:49.990 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f2872d9d700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28740af420 0x7f2874141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.963+0000 7f287259c700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2874097650 0x7f28740b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb5877fe700 1 -- 172.21.15.57:0/2714312215 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800b910 con 0x7fb5880967d0 2023-10-06T03:53:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0016630 con 0x7ff1dc0ae420 2023-10-06T03:53:49.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 Processor -- start 2023-10-06T03:53:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0016790 con 0x7ff1dc0ae420 2023-10-06T03:53:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0016b50 con 0x7ff1dc0ae420 2023-10-06T03:53:49.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 -- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2874097650 msgr2=0x7f28740b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2874097650 0x7f28740b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 -- 172.21.15.57:0/4040180510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28740af420 msgr2=0x7f2874141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28740af420 0x7f2874141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 -- 172.21.15.57:0/4040180510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286800a5d0 con 0x7f28740af050 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f2871d9b700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f287406a2e0 tx=0x7f2868019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800c9e0 con 0x7f28740af050 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800ce70 con 0x7f28740af050 2023-10-06T03:53:49.993 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680216a0 con 0x7f28740af050 2023-10-06T03:53:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28740b39a0 con 0x7f28740af050 2023-10-06T03:53:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28740b36c0 con 0x7f28740af050 2023-10-06T03:53:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 -- 172.21.15.57:0/726628310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c093880 msgr2=0x7fbc9c093c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 --2- 172.21.15.57:0/726628310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c093880 0x7fbc9c093c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c06ba00 tx=0x7fbc8c009220 comp rx=0 tx=0).stop 2023-10-06T03:53:49.994 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 -- 172.21.15.57:0/726628310 shutdown_connections 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 --2- 172.21.15.57:0/726628310 >> v2:172.21.15.105:3300/0 conn(0x7fbc9c145cc0 0x7fbc9c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 --2- 172.21.15.57:0/726628310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c093880 0x7fbc9c093c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fbca10da700 1 -- 172.21.15.57:0/726628310 >> 172.21.15.57:0/726628310 conn(0x7fbc9c068840 msgr2=0x7fbc9c068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- 172.21.15.57:0/2714312215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 msgr2=0x7fb5880af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/2714312215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb578009990 tx=0x7fb578009220 comp rx=0 tx=0).stop 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- 172.21.15.57:0/2714312215 shutdown_connections 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/2714312215 >> v2:172.21.15.105:3300/0 conn(0x7fb58806cf00 0x7fb58806d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.995 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/2714312215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880af050 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- 172.21.15.57:0/2714312215 >> 172.21.15.57:0/2714312215 conn(0x7fb588068840 msgr2=0x7fb588068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3932593725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b03e0 msgr2=0x7f5aa0152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3932593725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0152090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a900098e0 tx=0x7f5a900091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3932593725 shutdown_connections 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3932593725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0152090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3932593725 >> 172.21.15.57:0/3932593725 conn(0x7f5aa0067b40 msgr2=0x7f5aa00b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:49.996 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3932593725 shutdown_connections 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 -- start start 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9f580072f0 0x7f9f58035050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58037b30 con 0x7f9f58039ca0 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58037fc0 con 0x7f9f5803a100 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f66dd1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f58037660 con 0x7f9f580072f0 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc0a71e0 con 0x7ff1dc0ae420 2023-10-06T03:53:49.997 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc0a7760 con 0x7ff1dc0ae420 2023-10-06T03:53:49.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f655ce700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9f58039ca0 0x7f9f580c93a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49464/0 (socket says 172.21.15.57:49464) 2023-10-06T03:53:49.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f655ce700 1 -- 172.21.15.57:0/3823288332 learned_addr learned my addr 172.21.15.57:0/3823288332 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:49.998 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- 172.21.15.57:0/2714312215 shutdown_connections 2023-10-06T03:53:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f65dcf700 1 --2- 172.21.15.57:0/3823288332 >> v2:172.21.15.105:3300/0 conn(0x7f9f580072f0 0x7f9f58035050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f65dcf700 1 -- 172.21.15.57:0/3823288332 >> v1:172.21.15.105:6789/0 conn(0x7f9f5803a100 legacy=0x7f9f580c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f65dcf700 1 -- 172.21.15.57:0/3823288332 >> v1:172.21.15.57:6789/0 conn(0x7f9f58039ca0 legacy=0x7f9f580c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f65dcf700 1 -- 172.21.15.57:0/3823288332 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580ca1c0 con 0x7f9f580072f0 2023-10-06T03:53:49.999 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3932593725 wait complete. 2023-10-06T03:53:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- 172.21.15.57:0/2714312215 wait complete. 2023-10-06T03:53:50.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f9f65dcf700 1 --2- 172.21.15.57:0/3823288332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f580072f0 0x7f9f58035050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0098e0 tx=0x7f9f5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a173878bc9c4439f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc04be00 con 0x7ff1dc0ae420 2023-10-06T03:53:50.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff1d001f400 con 0x7ff1dc0ae420 2023-10-06T03:53:50.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 Processor -- start 2023-10-06T03:53:50.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7fb58d9b1700 1 -- start start 2023-10-06T03:53:50.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7ff1c2ffd700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 0x7ff1c8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.967+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2874068f50 con 0x7f28740af050 2023-10-06T03:53:50.002 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 Processor -- start 2023-10-06T03:53:50.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1d0080b50 con 0x7ff1dc0ae420 2023-10-06T03:53:50.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb58806cf00 0x7fb5880994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588099a20 con 0x7fb5880a6d40 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588096390 con 0x7fb58806cf00 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d9b1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880abf80 con 0x7fb5880967d0 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46978/0 (socket says 172.21.15.57:46978) 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 -- 172.21.15.57:0/899601246 learned_addr learned my addr 172.21.15.57:0/899601246 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58c9af700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb58806cf00 0x7fb5880994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7ff1daffd700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 0x7ff1c8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 -- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 msgr2=0x7fb5880aa4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880aa4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 -- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb58806cf00 msgr2=0x7fb5880994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb58806cf00 0x7fb5880994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 -- 172.21.15.57:0/899601246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009480 con 0x7fb5880a6d40 2023-10-06T03:53:50.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f28680103f0 con 0x7f28740af050 2023-10-06T03:53:50.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f28627fc700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 0x7f28540629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f286807dfd0 con 0x7f28740af050 2023-10-06T03:53:50.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f287259c700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 0x7f28540629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 -- start start 2023-10-06T03:53:50.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- 172.21.15.57:0/726628310 shutdown_connections 2023-10-06T03:53:50.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- 172.21.15.57:0/726628310 wait complete. 2023-10-06T03:53:50.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fb58d1b0700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c910 tx=0x7fb5800016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7ff1daffd700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 0x7ff1c8062ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009880 tx=0x7ff1d4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 Processor -- start 2023-10-06T03:53:50.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- start start 2023-10-06T03:53:50.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f9f64dcd700 1 -- 172.21.15.57:0/3823288332 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c009e80 con 0x7f9f580072f0 2023-10-06T03:53:50.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f9f64dcd700 1 -- 172.21.15.57:0/3823288332 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c00b760 con 0x7f9f580072f0 2023-10-06T03:53:50.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f9f64dcd700 1 -- 172.21.15.57:0/3823288332 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c00bb00 con 0x7f9f580072f0 2023-10-06T03:53:50.009 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f287259c700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 0x7f28540629d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2864001ed0 tx=0x7f2864001b30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c0af310 0x7fbc9c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 0x7fbc9c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0ab620 con 0x7fbc9c0af310 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0aa770 con 0x7fbc9c07eca0 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca10da700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c07e810 con 0x7fbc9c145cc0 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca08d9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca08d9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50752/0 (socket says 172.21.15.57:50752) 2023-10-06T03:53:50.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbca08d9700 1 -- 172.21.15.57:0/3158332754 learned_addr learned my addr 172.21.15.57:0/3158332754 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbc9b7fe700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 0x7fbc9c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f9f66dd1700 1 -- 172.21.15.57:0/3823288332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f580072f0 msgr2=0x7f9f58035050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/3823288332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f580072f0 0x7f9f58035050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0098e0 tx=0x7f9f5c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5aa006da50 0x7f5aa01427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b5250 0x7f5aa0148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00abf10 con 0x7f5aa00b5250 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0159970 con 0x7f5aa00b03e0 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa7b67700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0159c50 con 0x7f5aa006da50 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50742/0 (socket says 172.21.15.57:50742) 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 -- 172.21.15.57:0/3017235022 learned_addr learned my addr 172.21.15.57:0/3017235022 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7fbc9bfff700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c0af310 0x7fbc9c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa6104700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b5250 0x7f5aa0148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 -- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5aa006da50 msgr2=0x7f5aa01427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5aa006da50 0x7f5aa01427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 -- 172.21.15.57:0/3017235022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b5250 msgr2=0x7f5aa0148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b5250 0x7f5aa0148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.971+0000 7f5aa5102700 1 -- 172.21.15.57:0/3017235022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009420 con 0x7f5aa00b03e0 2023-10-06T03:53:50.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 -- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 msgr2=0x7fbc9c0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 -- 172.21.15.57:0/3158332754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c0af310 msgr2=0x7fbc9c0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c0af310 0x7fbc9c0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 -- 172.21.15.57:0/3158332754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c009480 con 0x7fbc9c145cc0 2023-10-06T03:53:50.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbca08d9700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:50.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5aa5102700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800cd30 tx=0x7f5a98001b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fbc9b7fe700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 0x7fbc9c147af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000c490 tx=0x7fbc90007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9800ce90 con 0x7f5aa00b03e0 2023-10-06T03:53:50.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 -- 172.21.15.57:0/3823288332 shutdown_connections 2023-10-06T03:53:50.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/3823288332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f580072f0 0x7f9f58035050 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9800ab70 con 0x7f5aa00b03e0 2023-10-06T03:53:50.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 -- 172.21.15.57:0/3823288332 >> 172.21.15.57:0/3823288332 conn(0x7f9f5803e740 msgr2=0x7f9f5803a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980070f0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 Processor -- start 2023-10-06T03:53:50.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 -- 172.21.15.57:0/3823288332 shutdown_connections 2023-10-06T03:53:50.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 -- start start 2023-10-06T03:53:50.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 Processor -- start 2023-10-06T03:53:50.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6d1c093880 0x7f6d1c093c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.019 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa014a710 con 0x7f5aa00b03e0 2023-10-06T03:53:50.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa01434e0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c145cc0 0x7f6d1c146140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c0966b0 con 0x7f6d1c0af310 2023-10-06T03:53:50.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c095430 con 0x7f6d1c093880 2023-10-06T03:53:50.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d22efb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c096340 con 0x7f6d1c145cc0 2023-10-06T03:53:50.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580012630 con 0x7fb5880a6d40 2023-10-06T03:53:50.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800127b0 con 0x7fb5880a6d40 2023-10-06T03:53:50.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5880abca0 con 0x7fb5880a6d40 2023-10-06T03:53:50.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 -- start start 2023-10-06T03:53:50.022 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580012b70 con 0x7fb5880a6d40 2023-10-06T03:53:50.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 -- 172.21.15.57:0/3823288332 wait complete. 2023-10-06T03:53:50.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff1d0051060 con 0x7ff1dc0ae420 2023-10-06T03:53:50.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5880aec90 con 0x7fb5880a6d40 2023-10-06T03:53:50.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d226fa700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c145cc0 0x7f6d1c146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d216f8700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6d1c0af310 0x7f6d1c0af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:42088/0 (socket says 172.21.15.57:42088) 2023-10-06T03:53:50.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d216f8700 1 -- 172.21.15.57:0/4042585717 learned_addr learned my addr 172.21.15.57:0/4042585717 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:50.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa004be00 con 0x7f5aa00b03e0 2023-10-06T03:53:50.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5a98035b50 con 0x7f5aa00b03e0 2023-10-06T03:53:50.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5880961f0 con 0x7fb5880a6d40 2023-10-06T03:53:50.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 0x7f5a84062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/4042585717 >> v2:172.21.15.57:3300/0 conn(0x7f6d1c093880 0x7f6d1c093c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d21ef9700 1 -- 172.21.15.57:0/4042585717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c145cc0 msgr2=0x7f6d1c146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/4042585717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c145cc0 0x7f6d1c146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d21ef9700 1 -- 172.21.15.57:0/4042585717 >> v1:172.21.15.105:6789/0 conn(0x7f6d1c0af310 legacy=0x7f6d1c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf400b28b0 0x7faf400b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf400b0110 0x7faf40145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf40142be0 con 0x7faf400b2c80 2023-10-06T03:53:50.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf40142380 con 0x7faf400b28b0 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf44a55700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400b2120 con 0x7faf400b0110 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf3dd9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf400b0110 0x7faf40145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf3dd9b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf400b0110 0x7faf40145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50760/0 (socket says 172.21.15.57:50760) 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7faf3dd9b700 1 -- 172.21.15.57:0/1085811644 learned_addr learned my addr 172.21.15.57:0/1085811644 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f6d21ef9700 1 -- 172.21.15.57:0/4042585717 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c096010 con 0x7f6d1c093880 2023-10-06T03:53:50.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a9807ced0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7faf3dd9b700 1 -- 172.21.15.57:0/1085811644 >> v2:172.21.15.57:3300/0 conn(0x7faf400b28b0 msgr2=0x7faf400b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:50.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7faf3dd9b700 1 --2- 172.21.15.57:0/1085811644 >> v2:172.21.15.57:3300/0 conn(0x7faf400b28b0 0x7faf400b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7faf3dd9b700 1 -- 172.21.15.57:0/1085811644 >> v1:172.21.15.57:6789/0 conn(0x7faf400b2c80 legacy=0x7faf400abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:50.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7faf3dd9b700 1 -- 172.21.15.57:0/1085811644 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40142590 con 0x7faf400b0110 2023-10-06T03:53:50.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 Processor -- start 2023-10-06T03:53:50.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.975+0000 7f9f66dd1700 1 -- start start 2023-10-06T03:53:50.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/4042585717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c093c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098d0 tx=0x7f6d0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6270d24830394e08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f5aa5903700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 0x7f5a84062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb580003030 con 0x7fb5880a6d40 2023-10-06T03:53:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9000ce40 con 0x7fbc9c145cc0 2023-10-06T03:53:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc90011590 con 0x7fbc9c145cc0 2023-10-06T03:53:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c0aa970 con 0x7fbc9c145cc0 2023-10-06T03:53:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc90011950 con 0x7fbc9c145cc0 2023-10-06T03:53:50.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c07e270 con 0x7fbc9c145cc0 2023-10-06T03:53:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fb584ff9700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb58007c910 con 0x7fb5880a6d40 2023-10-06T03:53:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fb58c9af700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7fb58c9af700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 0x7fb574062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb578009260 tx=0x7fb578016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f5aa5903700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 0x7f5a84062a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009740 tx=0x7f5a9c006c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7faf3dd9b700 1 --2- 172.21.15.57:0/1085811644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b0110 0x7faf40145900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf38014ac0 tx=0x7faf380143c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce49bb8a5c4b79a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 0x7f9f580e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f5803a100 0x7f9f580d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580dfb10 con 0x7f9f5803a100 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580c7490 con 0x7f9f58039ca0 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f66dd1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580e3ab0 con 0x7f9f580072f0 2023-10-06T03:53:50.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f65dcf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f65dcf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38664/0 (socket says 172.21.15.57:38664) 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f65dcf700 1 -- 172.21.15.57:0/1933870423 learned_addr learned my addr 172.21.15.57:0/1933870423 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 0x7f9f580e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 -- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 msgr2=0x7f9f580dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 -- 172.21.15.57:0/1933870423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f5803a100 msgr2=0x7f9f580d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f5803a100 0x7f9f580d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 -- 172.21.15.57:0/1933870423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c009420 con 0x7f9f58039ca0 2023-10-06T03:53:50.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f65dcf700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.979+0000 7f9f655ce700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 0x7f9f580e04a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f50000c00 tx=0x7f9f50007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d20ef7700 1 -- 172.21.15.57:0/4042585717 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c005c10 con 0x7f6d1c093880 2023-10-06T03:53:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d20ef7700 1 -- 172.21.15.57:0/4042585717 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c005d70 con 0x7f6d1c093880 2023-10-06T03:53:50.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d20ef7700 1 -- 172.21.15.57:0/4042585717 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c006240 con 0x7f6d1c093880 2023-10-06T03:53:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f286804e3c0 con 0x7f28740af050 2023-10-06T03:53:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c0a8190 con 0x7fbc9c145cc0 2023-10-06T03:53:50.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- 172.21.15.57:0/4042585717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 msgr2=0x7f6d1c093c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- 172.21.15.57:0/4042585717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c093c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0098d0 tx=0x7f6d0c009120 comp rx=0 tx=0).stop 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- 172.21.15.57:0/4042585717 shutdown_connections 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- 172.21.15.57:0/4042585717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c145cc0 0x7f6d1c146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- 172.21.15.57:0/4042585717 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c093c50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- 172.21.15.57:0/4042585717 >> 172.21.15.57:0/4042585717 conn(0x7f6d1c068840 msgr2=0x7f6d1c068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- 172.21.15.57:0/4042585717 shutdown_connections 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- 172.21.15.57:0/4042585717 wait complete. 2023-10-06T03:53:50.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb5880961f0 con 0x7fb5880a6d40 2023-10-06T03:53:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbc90011cc0 con 0x7fbc9c145cc0 2023-10-06T03:53:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbc83fff700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 0x7fbc88062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc9007be50 con 0x7fbc9c145cc0 2023-10-06T03:53:50.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 Processor -- start 2023-10-06T03:53:50.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbc9bfff700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 0x7fbc88062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- start start 2023-10-06T03:53:50.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7fbc9bfff700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 0x7fbc88062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c06b220 tx=0x7fbc8c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c0af310 0x7f6d1c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d1c145cc0 0x7f6d1c0acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c155ee0 con 0x7f6d1c093880 2023-10-06T03:53:50.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c156470 con 0x7f6d1c145cc0 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d22efb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c0ae290 con 0x7f6d1c0af310 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d21ef9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d21ef9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47034/0 (socket says 172.21.15.57:47034) 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d21ef9700 1 -- 172.21.15.57:0/399100032 learned_addr learned my addr 172.21.15.57:0/399100032 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d216f8700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c0af310 0x7f6d1c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.983+0000 7f6d226fa700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d1c145cc0 0x7f6d1c0acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 -- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c0af310 msgr2=0x7f6d1c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c0af310 0x7f6d1c0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 -- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d1c145cc0 msgr2=0x7f6d1c0acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d1c145cc0 0x7f6d1c0acc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 -- 172.21.15.57:0/399100032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0093c0 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d21ef9700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c06ba30 tx=0x7f6d0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c005c10 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c01b690 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c01ba90 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1c099b00 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c099780 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6d0c011420 con 0x7f6d1c093880 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 0x7f6d00062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d0c07e8a0 con 0x7f6d1c093880 2023-10-06T03:53:50.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50005b30 con 0x7f9f58039ca0 2023-10-06T03:53:50.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc9004c360 con 0x7fbc9c145cc0 2023-10-06T03:53:50.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f50005c90 con 0x7f9f58039ca0 2023-10-06T03:53:50.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f580e3d90 con 0x7f9f58039ca0 2023-10-06T03:53:50.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7faf3d59a700 1 -- 172.21.15.57:0/1085811644 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38013b50 con 0x7faf400b0110 2023-10-06T03:53:50.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50007320 con 0x7f9f58039ca0 2023-10-06T03:53:50.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f580e35f0 con 0x7f9f58039ca0 2023-10-06T03:53:50.044 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5a9804d4c0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7faf3d59a700 1 -- 172.21.15.57:0/1085811644 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38013cb0 con 0x7faf400b0110 2023-10-06T03:53:50.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.987+0000 7faf3d59a700 1 -- 172.21.15.57:0/1085811644 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38014050 con 0x7faf400b0110 2023-10-06T03:53:50.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 -- 172.21.15.57:0/1085811644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b0110 msgr2=0x7faf40145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 --2- 172.21.15.57:0/1085811644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b0110 0x7faf40145900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf38014ac0 tx=0x7faf380143c0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 -- 172.21.15.57:0/1085811644 shutdown_connections 2023-10-06T03:53:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 --2- 172.21.15.57:0/1085811644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b0110 0x7faf40145900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 --2- 172.21.15.57:0/1085811644 >> v2:172.21.15.57:3300/0 conn(0x7faf400b28b0 0x7faf400b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 -- 172.21.15.57:0/1085811644 >> 172.21.15.57:0/1085811644 conn(0x7faf40067070 msgr2=0x7faf40067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f6d216f8700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 0x7f6d00062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.046 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9f5001b3b0 con 0x7f9f58039ca0 2023-10-06T03:53:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f9f55ffb700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 0x7f9f44062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f6d216f8700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 0x7f6d00062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0b3c10 tx=0x7f6d18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f5007bd60 con 0x7f9f58039ca0 2023-10-06T03:53:50.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f9f65dcf700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 0x7f9f44062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7f9f65dcf700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 0x7f9f44062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c006dc0 tx=0x7f9f5c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.991+0000 7faf44a55700 1 -- 172.21.15.57:0/1085811644 shutdown_connections 2023-10-06T03:53:50.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 -- 172.21.15.57:0/1085811644 wait complete. 2023-10-06T03:53:50.048 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 Processor -- start 2023-10-06T03:53:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 -- start start 2023-10-06T03:53:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c0705e0 con 0x7f6d1c093880 2023-10-06T03:53:50.049 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f400052b0 con 0x7f9f58039ca0 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 0x7faf4013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 0x7faf4014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 0x7faf401513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4006cb30 con 0x7faf4014e330 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4013f5f0 con 0x7faf400b28b0 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf44a55700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4006dec0 con 0x7faf400b2c80 2023-10-06T03:53:50.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 0x7faf401513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3e59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 0x7faf4013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3dd9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 0x7faf4014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3e59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 0x7faf4013f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:50784/0 (socket says 172.21.15.57:50784) 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3e59c700 1 -- 172.21.15.57:0/3428517940 learned_addr learned my addr 172.21.15.57:0/3428517940 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3dd9b700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 0x7faf4014ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38680/0 (socket says 172.21.15.57:38680) 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 -- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 msgr2=0x7faf4014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 0x7faf4014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 -- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 msgr2=0x7faf4013f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 0x7faf4013f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 -- 172.21.15.57:0/3428517940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf38014600 con 0x7faf4014e330 2023-10-06T03:53:50.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:49.995+0000 7faf3ed9d700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 0x7faf401513f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b4c0 tx=0x7faf30009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9f5004c1f0 con 0x7f9f58039ca0 2023-10-06T03:53:50.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d0c04ed30 con 0x7f6d1c093880 2023-10-06T03:53:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000f510 con 0x7faf4014e330 2023-10-06T03:53:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3000f690 con 0x7faf4014e330 2023-10-06T03:53:50.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3000fa50 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7faf44a55700 1 -- 172.21.15.57:0/3428517940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4006cd10 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.003+0000 7faf44a55700 1 -- 172.21.15.57:0/3428517940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf40143470 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.007+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faf3001a400 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.007+0000 7faf2e7fc700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 0x7faf20062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.007+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf3007c0c0 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.007+0000 7faf3e59c700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 0x7faf20062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.011+0000 7faf3e59c700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 0x7faf20062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf34006fd0 tx=0x7faf34009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.015+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4006e070 con 0x7faf4014e330 2023-10-06T03:53:50.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.031+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faf4006e070 con 0x7faf4014e330 2023-10-06T03:53:50.321 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f287404b5f0 con 0x7f28740af050 2023-10-06T03:53:50.322 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f28627fc700 1 -- 172.21.15.57:0/4040180510 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2868026020 con 0x7f28740af050 2023-10-06T03:53:50.322 INFO:teuthology.orchestra.run.smithi057.stdout:60129542149 2023-10-06T03:53:50.324 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb5880961f0 con 0x7fb5880a6d40 2023-10-06T03:53:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 msgr2=0x7f28540629d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 0x7f28540629d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2864001ed0 tx=0x7f2864001b30 comp rx=0 tx=0).stop 2023-10-06T03:53:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 msgr2=0x7f2874141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f287406a2e0 tx=0x7f2868019000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.325 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 shutdown_connections 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2854060520 0x7f28540629d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.319+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28740af420 0x7f2874141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28740af050 0x7f2874141870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7f287359e700 1 --2- 172.21.15.57:0/4040180510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2874097650 0x7f28740b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 >> 172.21.15.57:0/4040180510 conn(0x7f287409a040 msgr2=0x7f28740677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7fb584ff9700 1 -- 172.21.15.57:0/899601246 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5880961f0 con 0x7fb5880a6d40 2023-10-06T03:53:50.327 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:50.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 shutdown_connections 2023-10-06T03:53:50.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.323+0000 7f287359e700 1 -- 172.21.15.57:0/4040180510 wait complete. 2023-10-06T03:53:50.332 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.327+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff1dc0a7c10 con 0x7ff1dc0ae420 2023-10-06T03:53:50.333 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.327+0000 7ff1c2ffd700 1 -- 172.21.15.57:0/172106096 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1d001a020 con 0x7ff1dc0ae420 2023-10-06T03:53:50.333 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:50.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.327+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f40005830 con 0x7f9f58039ca0 2023-10-06T03:53:50.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2023-10-06T03:53:50.338 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7f9f55ffb700 1 -- 172.21.15.57:0/1933870423 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f50017020 con 0x7f9f58039ca0 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 msgr2=0x7ff1c8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 0x7ff1c8062ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009880 tx=0x7ff1d4017000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 msgr2=0x7ff1dc13c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 0x7ff1dc13c0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0010940 tx=0x7ff1d0002760 comp rx=0 tx=0).stop 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 shutdown_connections 2023-10-06T03:53:50.339 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff1c8060620 0x7ff1c8062ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1dc0b5250 0x7ff1dc14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1dc0ae420 0x7ff1dc13c0b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 --2- 172.21.15.57:0/172106096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1dc06bdb0 0x7ff1dc0a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 >> 172.21.15.57:0/172106096 conn(0x7ff1dc067b40 msgr2=0x7ff1dc0ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 shutdown_connections 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.335+0000 7ff1e161e700 1 -- 172.21.15.57:0/172106096 wait complete. 2023-10-06T03:53:50.340 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:50.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 msgr2=0x7fb574062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 0x7fb574062a00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb578009260 tx=0x7fb578016000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 msgr2=0x7fb5880aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.341 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c910 tx=0x7fb5800016d0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 shutdown_connections 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb574060550 0x7fb574062a00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5880a6d40 0x7fb5880aaa10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5880967d0 0x7fb5880aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 --2- 172.21.15.57:0/899601246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb58806cf00 0x7fb5880994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.339+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 >> 172.21.15.57:0/899601246 conn(0x7fb588068840 msgr2=0x7fb5880b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 msgr2=0x7f9f44062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 0x7f9f44062a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c006dc0 tx=0x7f9f5c016000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 msgr2=0x7f9f580e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 0x7f9f580e04a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f50000c00 tx=0x7f9f50007e20 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 shutdown_connections 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9f44060550 0x7f9f44062a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f5803a100 0x7f9f580d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f58039ca0 0x7f9f580e04a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 --2- 172.21.15.57:0/1933870423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f580072f0 0x7f9f580dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 >> 172.21.15.57:0/1933870423 conn(0x7f9f5803e740 msgr2=0x7f9f580cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 shutdown_connections 2023-10-06T03:53:50.347 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7f9f66dd1700 1 -- 172.21.15.57:0/1933870423 wait complete. 2023-10-06T03:53:50.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 shutdown_connections 2023-10-06T03:53:50.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.343+0000 7fb58d9b1700 1 -- 172.21.15.57:0/899601246 wait complete. 2023-10-06T03:53:50.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2023-10-06T03:53:50.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.347+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6d1c04b5c0 con 0x7f6d1c093880 2023-10-06T03:53:50.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbc9c0a8190 con 0x7fbc9c145cc0 2023-10-06T03:53:50.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7f6d11ffb700 1 -- 172.21.15.57:0/399100032 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d0c052350 con 0x7f6d1c093880 2023-10-06T03:53:50.354 INFO:teuthology.orchestra.run.smithi057.stdout:60129542149 2023-10-06T03:53:50.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbc83fff700 1 -- 172.21.15.57:0/3158332754 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc9c0a8190 con 0x7fbc9c145cc0 2023-10-06T03:53:50.355 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:50.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 msgr2=0x7fbc88062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 0x7fbc88062a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c06b220 tx=0x7fbc8c016000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 msgr2=0x7fbc9c147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.357 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 0x7fbc9c147af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc9000c490 tx=0x7fbc90007ec0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 shutdown_connections 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbc88060550 0x7fbc88062a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc9c07eca0 0x7fbc9c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc9c145cc0 0x7fbc9c147af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.351+0000 7fbca10da700 1 --2- 172.21.15.57:0/3158332754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc9c0af310 0x7fbc9c0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.355+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 >> 172.21.15.57:0/3158332754 conn(0x7fbc9c068840 msgr2=0x7fbc9c0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.355+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 shutdown_connections 2023-10-06T03:53:50.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.355+0000 7fbca10da700 1 -- 172.21.15.57:0/3158332754 wait complete. 2023-10-06T03:53:50.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 msgr2=0x7f6d00062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 0x7f6d00062a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0b3c10 tx=0x7f6d18009040 comp rx=0 tx=0).stop 2023-10-06T03:53:50.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 msgr2=0x7f6d1c155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c06ba30 tx=0x7f6d0c016000 comp rx=0 tx=0).stop 2023-10-06T03:53:50.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 shutdown_connections 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6d00060550 0x7f6d00062a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d1c145cc0 0x7f6d1c0acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1c0af310 0x7f6d1c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 --2- 172.21.15.57:0/399100032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d1c093880 0x7f6d1c155970 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 >> 172.21.15.57:0/399100032 conn(0x7f6d1c068840 msgr2=0x7f6d1c0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 shutdown_connections 2023-10-06T03:53:50.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.359+0000 7f6d22efb700 1 -- 172.21.15.57:0/399100032 wait complete. 2023-10-06T03:53:50.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-10-06T03:53:50.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2023-10-06T03:53:50.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2023-10-06T03:53:50.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5aa006bdb0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5a95ffb700 1 -- 172.21.15.57:0/3017235022 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a98050ae0 con 0x7f5aa00b03e0 2023-10-06T03:53:50.374 INFO:teuthology.orchestra.run.smithi057.stdout:60129542149 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 msgr2=0x7f5a84062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 0x7f5a84062a30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c009740 tx=0x7f5a9c006c60 comp rx=0 tx=0).stop 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 msgr2=0x7f5aa0149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800cd30 tx=0x7f5a98001b10 comp rx=0 tx=0).stop 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 shutdown_connections 2023-10-06T03:53:50.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5a84060580 0x7f5a84062a30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa00b5250 0x7f5aa0148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5aa00b03e0 0x7f5aa0149a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 --2- 172.21.15.57:0/3017235022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5aa006da50 0x7f5aa01427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 >> 172.21.15.57:0/3017235022 conn(0x7f5aa0067b40 msgr2=0x7f5aa00b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 shutdown_connections 2023-10-06T03:53:50.378 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.371+0000 7f5aa7b67700 1 -- 172.21.15.57:0/3017235022 wait complete. 2023-10-06T03:53:50.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2023-10-06T03:53:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.403+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf4006e070 con 0x7faf4014e330 2023-10-06T03:53:50.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.403+0000 7faf2e7fc700 1 -- 172.21.15.57:0/3428517940 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf4006e070 con 0x7faf4014e330 2023-10-06T03:53:50.408 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 msgr2=0x7faf20062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 0x7faf20062ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf34006fd0 tx=0x7faf34009250 comp rx=0 tx=0).stop 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 msgr2=0x7faf401513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 0x7faf401513f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b4c0 tx=0x7faf30009060 comp rx=0 tx=0).stop 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 shutdown_connections 2023-10-06T03:53:50.410 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faf20060620 0x7faf20062ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf4014e330 0x7faf401513f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf400b2c80 0x7faf4014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 --2- 172.21.15.57:0/3428517940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf400b28b0 0x7faf4013f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 >> 172.21.15.57:0/3428517940 conn(0x7faf40067070 msgr2=0x7faf400b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 shutdown_connections 2023-10-06T03:53:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:50.407+0000 7faf1ffff700 1 -- 172.21.15.57:0/3428517940 wait complete. 2023-10-06T03:53:50.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2023-10-06T03:53:51.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:53:51.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:53:51.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:53:51.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:53:51.373 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:53:51.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:53:51.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:53:51.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:53:51.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 Processor -- start 2023-10-06T03:53:51.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 -- start start 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c08149b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c080af7e0 con 0x7f6c080ae690 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c080adc60 con 0x7f6c080afc70 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0ee53700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c080b00d0 con 0x7f6c080ac8e0 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0cbef700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6c080ae690 0x7f6c08141800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34578/0 (socket says 172.21.15.57:34578) 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0cbef700 1 -- 172.21.15.57:0/3700011805 learned_addr learned my addr 172.21.15.57:0/3700011805 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:51.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0d3f0700 1 --2- 172.21.15.57:0/3700011805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c08149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c077fe700 1 -- 172.21.15.57:0/3700011805 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72734515 0 0) 0x7f6c080af7e0 con 0x7f6c080ae690 2023-10-06T03:53:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c077fe700 1 -- 172.21.15.57:0/3700011805 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf0003570 con 0x7f6c080ae690 2023-10-06T03:53:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0d3f0700 1 -- 172.21.15.57:0/3700011805 >> v1:172.21.15.105:6789/0 conn(0x7f6c080afc70 legacy=0x7f6c08141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0d3f0700 1 -- 172.21.15.57:0/3700011805 >> v1:172.21.15.57:6789/0 conn(0x7f6c080ae690 legacy=0x7f6c08141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0d3f0700 1 -- 172.21.15.57:0/3700011805 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08142620 con 0x7f6c080ac8e0 2023-10-06T03:53:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c0d3f0700 1 --2- 172.21.15.57:0/3700011805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c08149b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000afa0 tx=0x7f6c0000a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ef1fe6e273d7cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c077fe700 1 -- 172.21.15.57:0/3700011805 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000f070 con 0x7f6c080ac8e0 2023-10-06T03:53:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.471+0000 7f6c077fe700 1 -- 172.21.15.57:0/3700011805 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000a2e0 con 0x7f6c080ac8e0 2023-10-06T03:53:51.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.475+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3700011805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 msgr2=0x7f6c08149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.475+0000 7f6c0ee53700 1 --2- 172.21.15.57:0/3700011805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c08149b50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000afa0 tx=0x7f6c0000a890 comp rx=0 tx=0).stop 2023-10-06T03:53:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3700011805 shutdown_connections 2023-10-06T03:53:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 --2- 172.21.15.57:0/3700011805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c08149b50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3700011805 >> 172.21.15.57:0/3700011805 conn(0x7f6c08067070 msgr2=0x7f6c08067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3700011805 shutdown_connections 2023-10-06T03:53:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3700011805 wait complete. 2023-10-06T03:53:51.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 Processor -- start 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- start start 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c0806c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c080afc70 0x7f6c0811cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08156aa0 con 0x7f6c080ae690 2023-10-06T03:53:51.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0811ea50 con 0x7f6c080afc70 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0ee53700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c08156190 con 0x7f6c080ac8e0 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c07fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c07fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45876/0 (socket says 172.21.15.57:45876) 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c07fff700 1 -- 172.21.15.57:0/3668700127 learned_addr learned my addr 172.21.15.57:0/3668700127 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0d3f0700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c080afc70 0x7f6c0811cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.479+0000 7f6c0cbef700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c0806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 -- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 msgr2=0x7f6c0806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c0806c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 -- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c080afc70 msgr2=0x7f6c0811cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c080afc70 0x7f6c0811cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 -- 172.21.15.57:0/3668700127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0000ab30 con 0x7f6c080ae690 2023-10-06T03:53:51.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c07fff700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c590 tx=0x7f6bfc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc011590 con 0x7f6c080ae690 2023-10-06T03:53:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc011710 con 0x7f6c080ae690 2023-10-06T03:53:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc011ad0 con 0x7f6c080ae690 2023-10-06T03:53:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3668700127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c080aae40 con 0x7f6c080ae690 2023-10-06T03:53:51.488 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.483+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3668700127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c08156730 con 0x7f6c080ae690 2023-10-06T03:53:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3668700127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0806ade0 con 0x7f6c080ae690 2023-10-06T03:53:51.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6bfc01b3b0 con 0x7f6c080ae690 2023-10-06T03:53:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c04ff9700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 0x7f6bec062aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bfc07bd00 con 0x7f6c080ae690 2023-10-06T03:53:51.490 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c0cbef700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 0x7f6bec062aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.491 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.487+0000 7f6c0cbef700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 0x7f6bec062aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800dbc0 tx=0x7f6bf8006120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 Processor -- start 2023-10-06T03:53:51.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 -- start start 2023-10-06T03:53:51.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6bfc04c170 con 0x7f6c080ae690 2023-10-06T03:53:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f69800ac8e0 0x7f69800ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69800adc60 con 0x7f69800ae910 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800abfa0 con 0x7f69800ac8e0 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f69872e0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980144b20 con 0x7f6980067b80 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:39922/0 (socket says 172.21.15.57:39922) 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 -- 172.21.15.57:0/4025945676 learned_addr learned my addr 172.21.15.57:0/4025945676 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 -- 172.21.15.57:0/4025945676 >> v2:172.21.15.105:3300/0 conn(0x7f69800ac8e0 msgr2=0x7f69800ae3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:53:51.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 --2- 172.21.15.57:0/4025945676 >> v2:172.21.15.105:3300/0 conn(0x7f69800ac8e0 0x7f69800ae3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 -- 172.21.15.57:0/4025945676 >> v1:172.21.15.57:6789/0 conn(0x7f69800ae910 legacy=0x7f6980141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 -- 172.21.15.57:0/4025945676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800af190 con 0x7f6980067b80 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.491+0000 7f698507c700 1 --2- 172.21.15.57:0/4025945676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6978009f50 tx=0x7f6978009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3ea54d54b29407d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.495+0000 7f6977fff700 1 -- 172.21.15.57:0/4025945676 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780090d0 con 0x7f6980067b80 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.495+0000 7f6977fff700 1 -- 172.21.15.57:0/4025945676 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697801f070 con 0x7f6980067b80 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.495+0000 7f69872e0700 1 -- 172.21.15.57:0/4025945676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 msgr2=0x7f69800afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.495+0000 7f69872e0700 1 --2- 172.21.15.57:0/4025945676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6978009f50 tx=0x7f6978009840 comp rx=0 tx=0).stop 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- 172.21.15.57:0/4025945676 shutdown_connections 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 --2- 172.21.15.57:0/4025945676 >> v2:172.21.15.105:3300/0 conn(0x7f69800ac8e0 0x7f69800ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 --2- 172.21.15.57:0/4025945676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f69800afc70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- 172.21.15.57:0/4025945676 >> 172.21.15.57:0/4025945676 conn(0x7f6980067070 msgr2=0x7f6980067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- 172.21.15.57:0/4025945676 shutdown_connections 2023-10-06T03:53:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- 172.21.15.57:0/4025945676 wait complete. 2023-10-06T03:53:51.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 Processor -- start 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- start start 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69800ac8e0 0x7f69800a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69800ae910 0x7f6980143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698014e130 con 0x7f69800ae910 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698011c3d0 con 0x7f69800ac8e0 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f69872e0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a9310 con 0x7f6980067b80 2023-10-06T03:53:51.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f698507c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f698587d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69800ae910 0x7f6980143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f698507c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:39934/0 (socket says 172.21.15.57:39934) 2023-10-06T03:53:51.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.499+0000 7f698507c700 1 -- 172.21.15.57:0/782636662 learned_addr learned my addr 172.21.15.57:0/782636662 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 -- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69800ac8e0 msgr2=0x7f69800a9df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69800ac8e0 0x7f69800a9df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 -- 172.21.15.57:0/782636662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69800ae910 msgr2=0x7f6980143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69800ae910 0x7f6980143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 -- 172.21.15.57:0/782636662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978009ae0 con 0x7f6980067b80 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f698507c700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f697800b770 tx=0x7f6978029000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780092e0 con 0x7f6980067b80 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69800a95f0 con 0x7f6980067b80 2023-10-06T03:53:51.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800aafc0 con 0x7f6980067b80 2023-10-06T03:53:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978000fe0 con 0x7f6980067b80 2023-10-06T03:53:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978036690 con 0x7f6980067b80 2023-10-06T03:53:51.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.503+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f697802d410 con 0x7f6980067b80 2023-10-06T03:53:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.507+0000 7f69757fa700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 0x7f696c062bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.507+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f697808f7a0 con 0x7f6980067b80 2023-10-06T03:53:51.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.507+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c0052b0 con 0x7f6980067b80 2023-10-06T03:53:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.507+0000 7f698487b700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 0x7f696c062bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.507+0000 7f698487b700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 0x7f696c062bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69800a77c0 tx=0x7f6970006bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.520 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.515+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f697805fb90 con 0x7f6980067b80 2023-10-06T03:53:51.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 Processor -- start 2023-10-06T03:53:51.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 -- start start 2023-10-06T03:53:51.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0b10f0 0x7f2e0c0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c0acbb0 con 0x7f2e0c0b14c0 2023-10-06T03:53:51.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0ad3e0 con 0x7f2e0c0a8910 2023-10-06T03:53:51.545 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.539+0000 7f2e10b14700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0ae840 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45888/0 (socket says 172.21.15.57:45888) 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 -- 172.21.15.57:0/2529694363 learned_addr learned my addr 172.21.15.57:0/2529694363 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0a59c700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0b10f0 0x7f2e0c0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 -- 172.21.15.57:0/2529694363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0b10f0 msgr2=0x7f2e0c0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0b10f0 0x7f2e0c0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 -- 172.21.15.57:0/2529694363 >> v1:172.21.15.105:6789/0 conn(0x7f2e0c0b14c0 legacy=0x7f2e0c0a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 -- 172.21.15.57:0/2529694363 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c0ad5e0 con 0x7f2e0c0a8910 2023-10-06T03:53:51.546 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.543+0000 7f2e0ad9d700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009f20 tx=0x7f2e04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25c6b1fd98b1b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e0959a700 1 -- 172.21.15.57:0/2529694363 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e070 con 0x7f2e0c0a8910 2023-10-06T03:53:51.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e0959a700 1 -- 172.21.15.57:0/2529694363 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400ba80 con 0x7f2e0c0a8910 2023-10-06T03:53:51.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e0959a700 1 -- 172.21.15.57:0/2529694363 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040092e0 con 0x7f2e0c0a8910 2023-10-06T03:53:51.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 -- 172.21.15.57:0/2529694363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0a8910 msgr2=0x7f2e0c0a74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009f20 tx=0x7f2e04009840 comp rx=0 tx=0).stop 2023-10-06T03:53:51.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 -- 172.21.15.57:0/2529694363 shutdown_connections 2023-10-06T03:53:51.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0a8910 0x7f2e0c0a74c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 --2- 172.21.15.57:0/2529694363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0b10f0 0x7f2e0c0ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 -- 172.21.15.57:0/2529694363 >> 172.21.15.57:0/2529694363 conn(0x7f2e0c067070 msgr2=0x7f2e0c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 Processor -- start 2023-10-06T03:53:51.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 -- start start 2023-10-06T03:53:51.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 -- 172.21.15.57:0/2529694363 shutdown_connections 2023-10-06T03:53:51.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb90095d80 0x7fbb90096150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900af700 con 0x7fbb900b0610 2023-10-06T03:53:51.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900af9e0 con 0x7fbb90069470 2023-10-06T03:53:51.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8ffff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb900af520 con 0x7fbb90095d80 2023-10-06T03:53:51.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7f2e10b14700 1 -- 172.21.15.57:0/2529694363 wait complete. 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbb900b0610 0x7fbb900935b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34586/0 (socket says 172.21.15.57:34586) 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8f7fe700 1 -- 172.21.15.57:0/3502416130 learned_addr learned my addr 172.21.15.57:0/3502416130 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8effd700 1 --2- 172.21.15.57:0/3502416130 >> v2:172.21.15.105:3300/0 conn(0x7fbb90095d80 0x7fbb90096150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8effd700 1 -- 172.21.15.57:0/3502416130 >> v1:172.21.15.105:6789/0 conn(0x7fbb90069470 legacy=0x7fbb900aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8effd700 1 -- 172.21.15.57:0/3502416130 >> v1:172.21.15.57:6789/0 conn(0x7fbb900b0610 legacy=0x7fbb900935b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8effd700 1 -- 172.21.15.57:0/3502416130 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90094390 con 0x7fbb90095d80 2023-10-06T03:53:51.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8effd700 1 --2- 172.21.15.57:0/3502416130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90095d80 0x7fbb90096150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009c20 tx=0x7fbb88009d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f3fb8da6416fce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fe2ef59e700 1 Processor -- start 2023-10-06T03:53:51.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8dffb700 1 -- 172.21.15.57:0/3502416130 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800d9e0 con 0x7fbb90095d80 2023-10-06T03:53:51.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fe2ef59e700 1 -- start start 2023-10-06T03:53:51.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fbb8dffb700 1 -- 172.21.15.57:0/3502416130 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8800db40 con 0x7fbb90095d80 2023-10-06T03:53:51.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fd17759e700 1 Processor -- start 2023-10-06T03:53:51.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.547+0000 7fd17759e700 1 -- start start 2023-10-06T03:53:51.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- 172.21.15.57:0/3502416130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90095d80 msgr2=0x7fbb90096150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd178093880 0x7fd178093c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 0x7fd178146140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17759e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1780966b0 con 0x7fd1780af310 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17759e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd178095430 con 0x7fd178093880 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd178096340 con 0x7fd178145cc0 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 0x7fd178146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd175d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd1780af310 0x7fd1780af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34606/0 (socket says 172.21.15.57:34606) 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd175d9b700 1 -- 172.21.15.57:0/831070199 learned_addr learned my addr 172.21.15.57:0/831070199 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17659c700 1 --2- 172.21.15.57:0/831070199 >> v2:172.21.15.105:3300/0 conn(0x7fd178093880 0x7fd178093c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ef59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2f00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ef59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f006d610 con 0x7fe2f00967d0 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ef59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00b2020 con 0x7fe2f00b1440 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ef59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00af7e0 con 0x7fe2f00af050 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ee59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe2f00967d0 0x7fe2f006cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34590/0 (socket says 172.21.15.57:34590) 2023-10-06T03:53:51.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ee59c700 1 -- 172.21.15.57:0/1201436772 learned_addr learned my addr 172.21.15.57:0/1201436772 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:51.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2f00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 Processor -- start 2023-10-06T03:53:51.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/3502416130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90095d80 0x7fbb90096150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009c20 tx=0x7fbb88009d00 comp rx=0 tx=0).stop 2023-10-06T03:53:51.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- 172.21.15.57:0/3502416130 shutdown_connections 2023-10-06T03:53:51.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/3502416130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb90095d80 0x7fbb90096150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- 172.21.15.57:0/3502416130 >> 172.21.15.57:0/3502416130 conn(0x7fbb90068840 msgr2=0x7fbb90068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- 172.21.15.57:0/3502416130 shutdown_connections 2023-10-06T03:53:51.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- 172.21.15.57:0/3502416130 wait complete. 2023-10-06T03:53:51.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255273148 0 0) 0x7fe2f006d610 con 0x7fe2f00967d0 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d8003570 con 0x7fe2f00967d0 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2714959764 0 0) 0x7fe2d8003570 con 0x7fe2f00967d0 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 msgr2=0x7fe2f00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2f00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 >> v1:172.21.15.105:6789/0 conn(0x7fe2f00b1440 legacy=0x7fe2f00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00afac0 con 0x7fe2f00967d0 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7fe2e8001970 con 0x7fe2f00967d0 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 >> v1:172.21.15.57:6789/0 conn(0x7fe2f00967d0 legacy=0x7fe2f006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8003a90 0x7fe2d8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8004d50 0x7fe2d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00af7e0 con 0x7fe2d8004d50 2023-10-06T03:53:51.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d800ff80 con 0x7fe2d8003a90 2023-10-06T03:53:51.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8010140 con 0x7fe2f00af050 2023-10-06T03:53:51.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 -- start start 2023-10-06T03:53:51.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8004d50 0x7fe2d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ee59c700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8003a90 0x7fe2d8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 -- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 msgr2=0x7fe2d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00af050 0x7fe2d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 -- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8003a90 msgr2=0x7fe2d8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8003a90 0x7fe2d8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 -- 172.21.15.57:0/1201436772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8003570 con 0x7fe2d8004d50 2023-10-06T03:53:51.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2eed9d700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8004d50 0x7fe2d80051c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00019a0 tx=0x7fe2e0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b715aca2839dd776 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 Processor -- start 2023-10-06T03:53:51.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fbb8ffff700 1 -- start start 2023-10-06T03:53:51.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17559a700 1 -- 172.21.15.57:0/831070199 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428309451 0 0) 0x7fd1780966b0 con 0x7fd1780af310 2023-10-06T03:53:51.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd17559a700 1 -- 172.21.15.57:0/831070199 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd160003570 con 0x7fd1780af310 2023-10-06T03:53:51.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 -- 172.21.15.57:0/831070199 >> v2:172.21.15.105:3300/0 conn(0x7fd178093880 msgr2=0x7fd178093c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 --2- 172.21.15.57:0/831070199 >> v2:172.21.15.105:3300/0 conn(0x7fd178093880 0x7fd178093c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 -- 172.21.15.57:0/831070199 >> v1:172.21.15.57:6789/0 conn(0x7fd1780af310 legacy=0x7fd1780af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 -- 172.21.15.57:0/831070199 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd178096010 con 0x7fd178145cc0 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0a8910 0x7f2e0c13d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c0b14c0 0x7f2e0c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c156190 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c152a70 con 0x7f2e0c0b14c0 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e10b14700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c1558d0 con 0x7f2e0c0a8910 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45908/0 (socket says 172.21.15.57:45908) 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 -- 172.21.15.57:0/4075743150 learned_addr learned my addr 172.21.15.57:0/4075743150 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e0a59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0a8910 0x7f2e0c13d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e0ad9d700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c0b14c0 0x7f2e0c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000c5d0 con 0x7fe2d8004d50 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900b0610 0x7fbb90163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900acc40 0x7fbb900ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90163fc0 con 0x7fbb90069470 2023-10-06T03:53:51.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb901647f0 con 0x7fbb900acc40 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900ad5e0 con 0x7fbb900b0610 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45912/0 (socket says 172.21.15.57:45912) 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 -- 172.21.15.57:0/2120600007 learned_addr learned my addr 172.21.15.57:0/2120600007 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8f7fe700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900acc40 0x7fbb900ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 -- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900b0610 msgr2=0x7fbb90163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900b0610 0x7fbb90163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 -- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900acc40 msgr2=0x7fbb900ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900acc40 0x7fbb900ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 -- 172.21.15.57:0/2120600007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88009790 con 0x7fbb90069470 2023-10-06T03:53:51.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fd176d9d700 1 --2- 172.21.15.57:0/831070199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 0x7fd178146140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd170009e60 tx=0x7fd170009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dba40ca66ffc0c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17559a700 1 -- 172.21.15.57:0/831070199 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000e070 con 0x7fd178145cc0 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17559a700 1 -- 172.21.15.57:0/831070199 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000bab0 con 0x7fd178145cc0 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17559a700 1 -- 172.21.15.57:0/831070199 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000be30 con 0x7fd178145cc0 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000c750 con 0x7fe2d8004d50 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7fe2ed59a700 1 -- 172.21.15.57:0/1201436772 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000cb10 con 0x7fe2d8004d50 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2ef59e700 1 -- 172.21.15.57:0/1201436772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8004d50 msgr2=0x7fe2d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/1201436772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d8004d50 0x7fe2d80051c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00019a0 tx=0x7fe2e0007d10 comp rx=0 tx=0).stop 2023-10-06T03:53:51.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2eed9d700 1 -- 172.21.15.57:0/1201436772 reap_dead start 2023-10-06T03:53:51.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 -- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0a8910 msgr2=0x7f2e0c13d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0a8910 0x7f2e0c13d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 -- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c0b14c0 msgr2=0x7f2e0c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c0b14c0 0x7f2e0c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.551+0000 7f2e09d9b700 1 -- 172.21.15.57:0/4075743150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04009ae0 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2e09d9b700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c5c0 tx=0x7f2dfc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8effd700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d590 tx=0x7fbb88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 -- 172.21.15.57:0/831070199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 msgr2=0x7fd178146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 --2- 172.21.15.57:0/831070199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 0x7fd178146140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd170009e60 tx=0x7fd170009780 comp rx=0 tx=0).stop 2023-10-06T03:53:51.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 -- 172.21.15.57:0/831070199 shutdown_connections 2023-10-06T03:53:51.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 --2- 172.21.15.57:0/831070199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd178145cc0 0x7fd178146140 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 --2- 172.21.15.57:0/831070199 >> v2:172.21.15.105:3300/0 conn(0x7fd178093880 0x7fd178093c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 -- 172.21.15.57:0/831070199 >> 172.21.15.57:0/831070199 conn(0x7fd178068840 msgr2=0x7fd178068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011590 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc011710 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011ad0 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2ef59e700 1 -- 172.21.15.57:0/1201436772 shutdown_connections 2023-10-06T03:53:51.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2ef59e700 1 -- 172.21.15.57:0/1201436772 >> 172.21.15.57:0/1201436772 conn(0x7fe2f0068840 msgr2=0x7fe2f0068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c155ad0 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c146d30 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88010c80 con 0x7fbb90069470 2023-10-06T03:53:51.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88010e00 con 0x7fbb90069470 2023-10-06T03:53:51.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880256d0 con 0x7fbb90069470 2023-10-06T03:53:51.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb901641a0 con 0x7fbb90069470 2023-10-06T03:53:51.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900b4450 con 0x7fbb90069470 2023-10-06T03:53:51.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 Processor -- start 2023-10-06T03:53:51.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fe2ef59e700 1 -- 172.21.15.57:0/1201436772 shutdown_connections 2023-10-06T03:53:51.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 -- start start 2023-10-06T03:53:51.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7fd17759e700 1 -- 172.21.15.57:0/831070199 shutdown_connections 2023-10-06T03:53:51.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 0x7f5b780af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780af590 con 0x7f5b7806d300 2023-10-06T03:53:51.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780a7b60 con 0x7f5b7806cf00 2023-10-06T03:53:51.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b77fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b2020 con 0x7f5b780967d0 2023-10-06T03:53:51.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c06ade0 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.555+0000 7f5b76ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 0x7f5b780af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b76ffd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 0x7f5b780af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59570/0 (socket says 172.21.15.57:59570) 2023-10-06T03:53:51.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b76ffd700 1 -- 172.21.15.57:0/1282355092 learned_addr learned my addr 172.21.15.57:0/1282355092 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 -- 172.21.15.57:0/831070199 wait complete. 2023-10-06T03:53:51.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb900705e0 con 0x7fbb90069470 2023-10-06T03:53:51.583 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fbb88019420 con 0x7fbb90069470 2023-10-06T03:53:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ef59e700 1 -- 172.21.15.57:0/1201436772 wait complete. 2023-10-06T03:53:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ef59e700 1 Processor -- start 2023-10-06T03:53:51.584 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 Processor -- start 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 -- start start 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 0x7fd178098250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1780af310 0x7fd1780aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 0x7fd178154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178099e60 con 0x7fd178145cc0 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd178098790 con 0x7fd178093880 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1780aac50 con 0x7fd1780af310 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067343196 0 0) 0x7f5b780a7b60 con 0x7f5b7806cf00 2023-10-06T03:53:51.585 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b60003570 con 0x7f5b7806cf00 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076271751 0 0) 0x7f5b60003570 con 0x7f5b7806cf00 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 msgr2=0x7f5b780af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 --2- 172.21.15.57:0/1282355092 >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 0x7f5b780af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 >> v1:172.21.15.57:6789/0 conn(0x7f5b7806d300 legacy=0x7f5b780a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780af7e0 con 0x7f5b7806cf00 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f5b6c001470 con 0x7f5b7806cf00 2023-10-06T03:53:51.586 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ef59e700 1 -- start start 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ef59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 0x7fe2f00b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ef59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 0x7fe2f0159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2dfc012420 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f2dfa7fc700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 0x7f2dec062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2dfc07c430 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f2e0a59c700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 0x7f2dec062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.587 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 Processor -- start 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 -- start start 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 0x7fd178098250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 >> v1:172.21.15.105:6789/0 conn(0x7f5b7806cf00 legacy=0x7f5b780a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b60003a60 0x7f5b60003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.588 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b600051c0 0x7f5b6000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 0x7fd178154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17659c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 0x7fd178098250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59584/0 (socket says 172.21.15.57:59584) 2023-10-06T03:53:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd17659c700 1 -- 172.21.15.57:0/2483290194 learned_addr learned my addr 172.21.15.57:0/2483290194 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 0x7f17b006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd175d9b700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1780af310 0x7fd1780aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb86ffd700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 0x7fbb70062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb8807e770 con 0x7fbb90069470 2023-10-06T03:53:51.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb8e7fc700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 0x7fbb70062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780b2020 con 0x7f5b600051c0 2023-10-06T03:53:51.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6000c0b0 con 0x7f5b60004810 2023-10-06T03:53:51.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6000c270 con 0x7f5b60003a60 2023-10-06T03:53:51.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b76ffd700 1 --2- 172.21.15.57:0/1282355092 >> v2:172.21.15.105:3300/0 conn(0x7f5b780967d0 0x7f5b780af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:51.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ee59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 0x7fe2f00b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17b00aff90 0x7f17b00b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b767fc700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fbb8e7fc700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 0x7fbb70062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007fd0 tx=0x7fbb80007b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 -- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1780af310 msgr2=0x7fd1780aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1780af310 0x7fd1780aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 -- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 msgr2=0x7fd178098250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 0x7fd178098250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fd176d9d700 1 -- 172.21.15.57:0/2483290194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170009a20 con 0x7fd178145cc0 2023-10-06T03:53:51.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fd176d9d700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 0x7fd178154e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd170016000 tx=0x7fd170019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b76ffd700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b60003a60 0x7f5b60003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f5b777fe700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b600051c0 0x7f5b6000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7fe2ee59c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 0x7fe2f00b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59592/0 (socket says 172.21.15.57:59592) 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17af7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 0x7f17b006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17af7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 0x7f17b006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59604/0 (socket says 172.21.15.57:59604) 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17af7fe700 1 -- 172.21.15.57:0/1042889980 learned_addr learned my addr 172.21.15.57:0/1042889980 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b006e5d0 con 0x7f17b0140620 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b006c7b0 con 0x7f17b00aff90 2023-10-06T03:53:51.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17aeffd700 1 --2- 172.21.15.57:0/1042889980 >> v2:172.21.15.57:3300/0 conn(0x7f17b00aff90 0x7f17b00b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.559+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00b0900 con 0x7f17b00b5250 2023-10-06T03:53:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2ee59c700 1 -- 172.21.15.57:0/4063816733 learned_addr learned my addr 172.21.15.57:0/4063816733 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 0x7fe2f0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f2e0a59c700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 0x7f2dec062a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e00006fd0 tx=0x7f2e00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 -- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b60003a60 msgr2=0x7f5b60003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b60003a60 0x7f5b60003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 -- 172.21.15.57:0/1282355092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b600051c0 msgr2=0x7f5b6000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b600051c0 0x7f5b6000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 -- 172.21.15.57:0/1282355092 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60003570 con 0x7f5b60004810 2023-10-06T03:53:51.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b777fe700 1 -- 172.21.15.57:0/1282355092 reap_dead start 2023-10-06T03:53:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f17aeffd700 1 -- 172.21.15.57:0/1042889980 >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 msgr2=0x7f17b006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f17aeffd700 1 --2- 172.21.15.57:0/1042889980 >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 0x7f17b006c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f17aeffd700 1 -- 172.21.15.57:0/1042889980 >> v1:172.21.15.57:6789/0 conn(0x7f17b0140620 legacy=0x7f17b0140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00a9490 0x7fe2f00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00aabe0 con 0x7fe2f00a4d90 2023-10-06T03:53:51.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f17aeffd700 1 -- 172.21.15.57:0/1042889980 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b006d4a0 con 0x7f17b00aff90 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b56b0 con 0x7fe2d8004d50 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00a3be0 con 0x7fe2f00a9490 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2eed9d700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00a9490 0x7fe2f00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 -- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00a9490 msgr2=0x7fe2f00a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00a9490 0x7fe2f00a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 -- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 msgr2=0x7fe2f00b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 0x7fe2f00b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00a5d20 con 0x7fe2f00a4d90 2023-10-06T03:53:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f17aeffd700 1 --2- 172.21.15.57:0/1042889980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00aff90 0x7f17b00b03c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17b006bbb0 tx=0x7f17a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f655bb8c93c4eaed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b767fc700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b60004c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c2d0 tx=0x7f5b6c007830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550a046135248683 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7fe2edd9b700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 0x7fe2f0159490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40119a0 tx=0x7fe2e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00cba0 con 0x7f5b60004810 2023-10-06T03:53:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00cd00 con 0x7f5b60004810 2023-10-06T03:53:51.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b75ffb700 1 -- 172.21.15.57:0/1282355092 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c012670 con 0x7f5b60004810 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 msgr2=0x7f5b60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b60004c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c2d0 tx=0x7f5b6c007830 comp rx=0 tx=0).stop 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- 172.21.15.57:0/1282355092 shutdown_connections 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 --2- 172.21.15.57:0/1282355092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b60004c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- 172.21.15.57:0/1282355092 >> 172.21.15.57:0/1282355092 conn(0x7f5b78068840 msgr2=0x7f5b78068c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- 172.21.15.57:0/1282355092 shutdown_connections 2023-10-06T03:53:51.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- 172.21.15.57:0/1282355092 wait complete. 2023-10-06T03:53:51.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2dfc04c950 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 Processor -- start 2023-10-06T03:53:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.563+0000 7f5b77fff700 1 -- start start 2023-10-06T03:53:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b781550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b78094390 0x7f5b78095420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78091b00 con 0x7f5b78095960 2023-10-06T03:53:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78095db0 con 0x7f5b60004810 2023-10-06T03:53:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b77fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78094940 con 0x7f5b78094390 2023-10-06T03:53:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b76ffd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b781550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45954/0 (socket says 172.21.15.57:45954) 2023-10-06T03:53:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 -- 172.21.15.57:0/4086765008 learned_addr learned my addr 172.21.15.57:0/4086765008 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b767fc700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b78094390 0x7f5b78095420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 -- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b78094390 msgr2=0x7f5b78095420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b78094390 0x7f5b78095420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 -- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 msgr2=0x7f5b781550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b781550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 -- 172.21.15.57:0/4086765008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78094c20 con 0x7f5b78095960 2023-10-06T03:53:51.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7f5b777fe700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b22c0 tx=0x7f5b700014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700070e0 con 0x7fd178145cc0 2023-10-06T03:53:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170021070 con 0x7fd178145cc0 2023-10-06T03:53:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd178149770 con 0x7fd178145cc0 2023-10-06T03:53:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170012d80 con 0x7fd178145cc0 2023-10-06T03:53:51.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.567+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1780b4410 con 0x7fd178145cc0 2023-10-06T03:53:51.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb8804eda0 con 0x7fbb90069470 2023-10-06T03:53:51.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd170023030 con 0x7fd178145cc0 2023-10-06T03:53:51.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fd1667fc700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 0x7fd158062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd17007e660 con 0x7fd178145cc0 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fd17659c700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 0x7fd158062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.571+0000 7fd17659c700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 0x7fd158062a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd168009dc0 tx=0x7fd168009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700135f0 con 0x7f5b78095960 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70013770 con 0x7f5b78095960 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70013b30 con 0x7f5b78095960 2023-10-06T03:53:51.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400f940 con 0x7fe2f00a4d90 2023-10-06T03:53:51.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e400faa0 con 0x7fe2f00a4d90 2023-10-06T03:53:51.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400fe60 con 0x7fe2f00a4d90 2023-10-06T03:53:51.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f00a6000 con 0x7fe2f00a4d90 2023-10-06T03:53:51.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f00a45b0 con 0x7fe2f00a4d90 2023-10-06T03:53:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f17ae7fc700 1 -- 172.21.15.57:0/1042889980 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011630 con 0x7f17b00aff90 2023-10-06T03:53:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f17ae7fc700 1 -- 172.21.15.57:0/1042889980 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0011790 con 0x7f17b00aff90 2023-10-06T03:53:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f17ae7fc700 1 -- 172.21.15.57:0/1042889980 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011630 con 0x7f17b00aff90 2023-10-06T03:53:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00aff90 msgr2=0x7f17b00b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7f17b612e700 1 --2- 172.21.15.57:0/1042889980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00aff90 0x7f17b00b03c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17b006bbb0 tx=0x7f17a00091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe2e4014650 con 0x7fe2f00a4d90 2023-10-06T03:53:51.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 0x7fe2d0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2e4018030 con 0x7fe2f00a4d90 2023-10-06T03:53:51.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.575+0000 7fe2ee59c700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 0x7fe2d0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd178099fd0 con 0x7fd178145cc0 2023-10-06T03:53:51.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7fe2ee59c700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 0x7fe2d0062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8001aa0 tx=0x7fe2e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78094f00 con 0x7f5b78095960 2023-10-06T03:53:51.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 shutdown_connections 2023-10-06T03:53:51.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f17b612e700 1 --2- 172.21.15.57:0/1042889980 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00aff90 0x7f17b00b03c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f17b612e700 1 --2- 172.21.15.57:0/1042889980 >> v2:172.21.15.105:3300/0 conn(0x7f17b00b5250 0x7f17b006c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 >> 172.21.15.57:0/1042889980 conn(0x7f17b0067b10 msgr2=0x7f17b00b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b78155bf0 con 0x7f5b78095960 2023-10-06T03:53:51.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f00aaa40 con 0x7fe2f00a4d90 2023-10-06T03:53:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.579+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 shutdown_connections 2023-10-06T03:53:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 -- 172.21.15.57:0/1042889980 wait complete. 2023-10-06T03:53:51.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 Processor -- start 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 -- start start 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17b00aff90 0x7f17b0145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17b0140620 0x7f17b014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b01499b0 con 0x7f17b00b5250 2023-10-06T03:53:51.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b014a210 con 0x7f17b00aff90 2023-10-06T03:53:51.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17b612e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00ac140 con 0x7f17b0140620 2023-10-06T03:53:51.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45960/0 (socket says 172.21.15.57:45960) 2023-10-06T03:53:51.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17af7fe700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17b00aff90 0x7f17b0145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17affff700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17b0140620 0x7f17b014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 -- 172.21.15.57:0/2330139575 learned_addr learned my addr 172.21.15.57:0/2330139575 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:51.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 -- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17b0140620 msgr2=0x7f17b014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17b0140620 0x7f17b014c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 -- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17b00aff90 msgr2=0x7f17b0145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17b00aff90 0x7f17b0145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.583+0000 7f17aeffd700 1 -- 172.21.15.57:0/2330139575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0009420 con 0x7f17b00b5250 2023-10-06T03:53:51.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.587+0000 7f17aeffd700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17a00091e0 tx=0x7f17a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.587+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd178099fd0 con 0x7fd178145cc0 2023-10-06T03:53:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.587+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f5b7001f460 con 0x7f5b78095960 2023-10-06T03:53:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.587+0000 7f5b5effd700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 0x7f5b64062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.587+0000 7f5b76ffd700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 0x7f5b64062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.591+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78094760 con 0x7f5b78095960 2023-10-06T03:53:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.591+0000 7f5b76ffd700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 0x7f5b64062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006ce0 tx=0x7f5b68009220 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.591+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0011630 con 0x7f17b00b5250 2023-10-06T03:53:51.629 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b0147d90 con 0x7f17b00b5250 2023-10-06T03:53:51.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0149ea0 con 0x7f17b00b5250 2023-10-06T03:53:51.630 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5b70051510 con 0x7f5b78095960 2023-10-06T03:53:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe2f00aaa40 con 0x7fe2f00a4d90 2023-10-06T03:53:51.631 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a001bdf0 con 0x7f17b00b5250 2023-10-06T03:53:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.595+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0025670 con 0x7f17b00b5250 2023-10-06T03:53:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.599+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17900052b0 con 0x7f17b00b5250 2023-10-06T03:53:51.632 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.607+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5b7004d110 con 0x7f5b78095960 2023-10-06T03:53:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.607+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f17a002e440 con 0x7f17b00b5250 2023-10-06T03:53:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.607+0000 7f17977fe700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 0x7f1798062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:51.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.607+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17a0052d00 con 0x7f17b00b5250 2023-10-06T03:53:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.611+0000 7f17af7fe700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 0x7f1798062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.611+0000 7f17af7fe700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 0x7f1798062b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17a800f570 tx=0x7f17a800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:51.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.615+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f17a004e900 con 0x7f17b00b5250 2023-10-06T03:53:51.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.799+0000 7f6c0ee53700 1 -- 172.21.15.57:0/3668700127 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c080ad6a0 con 0x7f6c080ae690 2023-10-06T03:53:51.803 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.799+0000 7f6c04ff9700 1 -- 172.21.15.57:0/3668700127 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bfc04f790 con 0x7f6c080ae690 2023-10-06T03:53:51.805 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:51.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 msgr2=0x7f6bec062aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 0x7f6bec062aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800dbc0 tx=0x7f6bf8006120 comp rx=0 tx=0).stop 2023-10-06T03:53:51.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 msgr2=0x7f6c08155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c590 tx=0x7f6bfc00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 shutdown_connections 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bec0605f0 0x7f6bec062aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c080afc70 0x7f6c0811cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c080ae690 0x7f6c08155c50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 --2- 172.21.15.57:0/3668700127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c080ac8e0 0x7f6c0806c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 >> 172.21.15.57:0/3668700127 conn(0x7f6c08067070 msgr2=0x7f6c080b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 shutdown_connections 2023-10-06T03:53:51.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.807+0000 7f6bf67fc700 1 -- 172.21.15.57:0/3668700127 wait complete. 2023-10-06T03:53:51.823 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.819+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f695c005560 con 0x7f6980067b80 2023-10-06T03:53:51.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2023-10-06T03:53:51.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.819+0000 7f69757fa700 1 -- 172.21.15.57:0/782636662 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6978031020 con 0x7f6980067b80 2023-10-06T03:53:51.825 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:51.825 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 msgr2=0x7f696c062bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 0x7f696c062bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69800a77c0 tx=0x7f6970006bd0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 msgr2=0x7f698014dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f697800b770 tx=0x7f6978029000 comp rx=0 tx=0).stop 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 shutdown_connections 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f696c060740 0x7f696c062bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69800ae910 0x7f6980143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69800ac8e0 0x7f69800a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 --2- 172.21.15.57:0/782636662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6980067b80 0x7f698014dbf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 >> 172.21.15.57:0/782636662 conn(0x7f6980067070 msgr2=0x7f69800b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 shutdown_connections 2023-10-06T03:53:51.828 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.823+0000 7f69872e0700 1 -- 172.21.15.57:0/782636662 wait complete. 2023-10-06T03:53:51.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2023-10-06T03:53:51.840 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.852 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.847+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2e0c0b4360 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.853 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.847+0000 7f2dfa7fc700 1 -- 172.21.15.57:0/4075743150 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dfc017090 con 0x7f2e0c0b10f0 2023-10-06T03:53:51.853 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 msgr2=0x7f2dec062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 0x7f2dec062a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e00006fd0 tx=0x7f2e00008040 comp rx=0 tx=0).stop 2023-10-06T03:53:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 msgr2=0x7f2e0c151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.856 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c5c0 tx=0x7f2dfc00c8d0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 shutdown_connections 2023-10-06T03:53:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2dec0605d0 0x7f2dec062a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c0b14c0 0x7f2e0c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e0c0b10f0 0x7f2e0c151ff0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.857 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 --2- 172.21.15.57:0/4075743150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e0c0a8910 0x7f2e0c13d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 >> 172.21.15.57:0/4075743150 conn(0x7f2e0c067070 msgr2=0x7f2e0c147630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 shutdown_connections 2023-10-06T03:53:51.858 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.851+0000 7f2e10b14700 1 -- 172.21.15.57:0/4075743150 wait complete. 2023-10-06T03:53:51.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2023-10-06T03:53:51.869 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe2f00a4410 con 0x7fe2f00a4d90 2023-10-06T03:53:51.870 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2de7fc700 1 -- 172.21.15.57:0/4063816733 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2f00a4410 con 0x7fe2f00a4d90 2023-10-06T03:53:51.870 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 msgr2=0x7fe2d0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 0x7fe2d0062a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8001aa0 tx=0x7fe2e8009040 comp rx=0 tx=0).stop 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 msgr2=0x7fe2f0159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 0x7fe2f0159490 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40119a0 tx=0x7fe2e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 shutdown_connections 2023-10-06T03:53:51.872 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe2d0060580 0x7fe2d0062a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f00a9490 0x7fe2f00a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2f00a4d90 0x7fe2f0159490 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 --2- 172.21.15.57:0/4063816733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2d8004d50 0x7fe2f00b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 >> 172.21.15.57:0/4063816733 conn(0x7fe2f0068840 msgr2=0x7fe2f00ac7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 shutdown_connections 2023-10-06T03:53:51.873 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.867+0000 7fe2ef59e700 1 -- 172.21.15.57:0/4063816733 wait complete. 2023-10-06T03:53:51.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2023-10-06T03:53:51.884 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.883+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1790005830 con 0x7f17b00b5250 2023-10-06T03:53:51.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.883+0000 7f17977fe700 1 -- 172.21.15.57:0/2330139575 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17a0051f20 con 0x7f17b00b5250 2023-10-06T03:53:51.888 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-10-06T03:53:51.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 msgr2=0x7f1798062b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 0x7f1798062b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17a800f570 tx=0x7f17a800b040 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 msgr2=0x7f17b0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17a00091e0 tx=0x7f17a0017000 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 shutdown_connections 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f17980606a0 0x7f1798062b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17b0140620 0x7f17b014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17b00b5250 0x7f17b0159900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 --2- 172.21.15.57:0/2330139575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17b00aff90 0x7f17b0145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 >> 172.21.15.57:0/2330139575 conn(0x7f17b0067b10 msgr2=0x7f17b013e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 shutdown_connections 2023-10-06T03:53:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7f17b612e700 1 -- 172.21.15.57:0/2330139575 wait complete. 2023-10-06T03:53:51.892 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb900705e0 con 0x7fbb90069470 2023-10-06T03:53:51.893 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.887+0000 7fbb86ffd700 1 -- 172.21.15.57:0/2120600007 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb88052380 con 0x7fbb90069470 2023-10-06T03:53:51.893 INFO:teuthology.orchestra.run.smithi057.stdout:60129542152 2023-10-06T03:53:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 msgr2=0x7fbb70062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 0x7fbb70062ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007fd0 tx=0x7fbb80007b20 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 msgr2=0x7fbb900b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d590 tx=0x7fbb88017000 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 shutdown_connections 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fbb70060620 0x7fbb70062ad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb900acc40 0x7fbb900ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb900b0610 0x7fbb90163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 --2- 172.21.15.57:0/2120600007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb90069470 0x7fbb900b3960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 >> 172.21.15.57:0/2120600007 conn(0x7fbb90068840 msgr2=0x7fbb9006df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 shutdown_connections 2023-10-06T03:53:51.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fbb8ffff700 1 -- 172.21.15.57:0/2120600007 wait complete. 2023-10-06T03:53:51.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd178099fd0 con 0x7fd178145cc0 2023-10-06T03:53:51.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7fd1667fc700 1 -- 172.21.15.57:0/2483290194 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd178099fd0 con 0x7fd178145cc0 2023-10-06T03:53:51.898 INFO:teuthology.orchestra.run.smithi057.stdout:60129542151 2023-10-06T03:53:51.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5b780950f0 con 0x7f5b78095960 2023-10-06T03:53:51.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.891+0000 7f5b5effd700 1 -- 172.21.15.57:0/4086765008 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b70050730 con 0x7f5b78095960 2023-10-06T03:53:51.899 INFO:teuthology.orchestra.run.smithi057.stdout:60129542150 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 msgr2=0x7fd158062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 0x7fd158062a00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd168009dc0 tx=0x7fd168009120 comp rx=0 tx=0).stop 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 msgr2=0x7fd178154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 0x7fd178154e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd170016000 tx=0x7fd170019000 comp rx=0 tx=0).stop 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 shutdown_connections 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd158060550 0x7fd158062a00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd178145cc0 0x7fd178154e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1780af310 0x7fd1780aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 --2- 172.21.15.57:0/2483290194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd178093880 0x7fd178098250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 >> 172.21.15.57:0/2483290194 conn(0x7fd178068840 msgr2=0x7fd178093c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 msgr2=0x7f5b64062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 0x7f5b64062b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006ce0 tx=0x7f5b68009220 comp rx=0 tx=0).stop 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 msgr2=0x7f5b780add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b780b22c0 tx=0x7f5b700014d0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 shutdown_connections 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f5b64060650 0x7f5b64062b00 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006ce0 tx=0x7f5b68009220 comp rx=0 tx=0).stop 2023-10-06T03:53:51.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b78095960 0x7f5b780add90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b78094390 0x7f5b78095420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 --2- 172.21.15.57:0/4086765008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b60004810 0x7f5b781550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 >> 172.21.15.57:0/4086765008 conn(0x7f5b78068840 msgr2=0x7f5b780b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 shutdown_connections 2023-10-06T03:53:51.903 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 shutdown_connections 2023-10-06T03:53:51.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7fd17759e700 1 -- 172.21.15.57:0/2483290194 wait complete. 2023-10-06T03:53:51.904 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:51.895+0000 7f5b77fff700 1 -- 172.21.15.57:0/4086765008 wait complete. 2023-10-06T03:53:51.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2023-10-06T03:53:51.905 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2023-10-06T03:53:51.907 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-10-06T03:53:51.911 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-10-06T03:53:51.912 DEBUG:teuthology.parallel:result is None 2023-10-06T03:53:51.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:53:51.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:53:52.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.055+0000 7fb284fe7700 1 Processor -- start 2023-10-06T03:53:52.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.055+0000 7fb284fe7700 1 -- start start 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2800acd70 0x7fb2800ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800ae200 con 0x7fb2800abb10 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800a7cd0 con 0x7fb280146600 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800b01e0 con 0x7fb2800acd70 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2800abb10 0x7fb2800abf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34642/0 (socket says 172.21.15.57:34642) 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27effd700 1 -- 172.21.15.57:0/2610649199 learned_addr learned my addr 172.21.15.57:0/2610649199 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27f7fe700 1 --2- 172.21.15.57:0/2610649199 >> v2:172.21.15.105:3300/0 conn(0x7fb2800acd70 0x7fb2800ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27e7fc700 1 -- 172.21.15.57:0/2610649199 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080664161 0 0) 0x7fb2800ae200 con 0x7fb2800abb10 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27e7fc700 1 -- 172.21.15.57:0/2610649199 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb268004680 con 0x7fb2800abb10 2023-10-06T03:53:52.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27f7fe700 1 -- 172.21.15.57:0/2610649199 >> v1:172.21.15.105:6789/0 conn(0x7fb280146600 legacy=0x7fb2801489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27f7fe700 1 -- 172.21.15.57:0/2610649199 >> v1:172.21.15.57:6789/0 conn(0x7fb2800abb10 legacy=0x7fb2800abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27f7fe700 1 -- 172.21.15.57:0/2610649199 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800b03f0 con 0x7fb2800acd70 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27f7fe700 1 --2- 172.21.15.57:0/2610649199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800acd70 0x7fb2800ad140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb278009e60 tx=0x7fb278009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71e9d93d17c4bfb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27e7fc700 1 -- 172.21.15.57:0/2610649199 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800bb60 con 0x7fb2800acd70 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27e7fc700 1 -- 172.21.15.57:0/2610649199 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800bcc0 con 0x7fb2800acd70 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb27e7fc700 1 -- 172.21.15.57:0/2610649199 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278011670 con 0x7fb2800acd70 2023-10-06T03:53:52.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- 172.21.15.57:0/2610649199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800acd70 msgr2=0x7fb2800ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 --2- 172.21.15.57:0/2610649199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800acd70 0x7fb2800ad140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb278009e60 tx=0x7fb278009780 comp rx=0 tx=0).stop 2023-10-06T03:53:52.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- 172.21.15.57:0/2610649199 shutdown_connections 2023-10-06T03:53:52.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 --2- 172.21.15.57:0/2610649199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800acd70 0x7fb2800ad140 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- 172.21.15.57:0/2610649199 >> 172.21.15.57:0/2610649199 conn(0x7fb280067070 msgr2=0x7fb280067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- 172.21.15.57:0/2610649199 shutdown_connections 2023-10-06T03:53:52.067 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- 172.21.15.57:0/2610649199 wait complete. 2023-10-06T03:53:52.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 Processor -- start 2023-10-06T03:53:52.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.059+0000 7fb284fe7700 1 -- start start 2023-10-06T03:53:52.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800abb10 0x7fb28013ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2800acd70 0x7fb28014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28012f550 con 0x7fb280146600 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28014df80 con 0x7fb2800abb10 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb280151060 con 0x7fb2800acd70 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45976/0 (socket says 172.21.15.57:45976) 2023-10-06T03:53:52.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 -- 172.21.15.57:0/1749169640 learned_addr learned my addr 172.21.15.57:0/1749169640 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27f7fe700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800abb10 0x7fb28013ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27effd700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2800acd70 0x7fb28014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 -- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2800acd70 msgr2=0x7fb28014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2800acd70 0x7fb28014da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 -- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800abb10 msgr2=0x7fb28013ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.072 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800abb10 0x7fb28013ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 -- 172.21.15.57:0/1749169640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009a20 con 0x7fb280146600 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb27ffff700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c4c0 tx=0x7fb270007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270011590 con 0x7fb280146600 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb270011710 con 0x7fb280146600 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb280151340 con 0x7fb280146600 2023-10-06T03:53:52.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270011ad0 con 0x7fb280146600 2023-10-06T03:53:52.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28013fd30 con 0x7fb280146600 2023-10-06T03:53:52.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28013ff20 con 0x7fb280146600 2023-10-06T03:53:52.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb27001b3b0 con 0x7fb280146600 2023-10-06T03:53:52.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.063+0000 7fb2677fe700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 0x7fb26c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.067+0000 7fb27f7fe700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 0x7fb26c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.067+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb27007bce0 con 0x7fb280146600 2023-10-06T03:53:52.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.067+0000 7fb27f7fe700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 0x7fb26c062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097c0 tx=0x7fb27801b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.071+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb27004c170 con 0x7fb280146600 2023-10-06T03:53:52.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.223+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb280151870 con 0x7fb26c060550 2023-10-06T03:53:52.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.239+0000 7fb2677fe700 1 -- 172.21.15.57:0/1749169640 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286458 (secure 0 0 0) 0x7fb280151870 con 0x7fb26c060550 2023-10-06T03:53:52.245 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 msgr2=0x7fb26c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 0x7fb26c062a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097c0 tx=0x7fb27801b000 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 msgr2=0x7fb28013e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c4c0 tx=0x7fb270007f50 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 shutdown_connections 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb26c060550 0x7fb26c062a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb280146600 0x7fb28013e750 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2800acd70 0x7fb28014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 --2- 172.21.15.57:0/1749169640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2800abb10 0x7fb28013ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 >> 172.21.15.57:0/1749169640 conn(0x7fb280067070 msgr2=0x7fb28006ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 shutdown_connections 2023-10-06T03:53:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.243+0000 7fb284fe7700 1 -- 172.21.15.57:0/1749169640 wait complete. 2023-10-06T03:53:52.249 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:53:52.260 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-06T03:53:50.625632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397960,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576760,"statfs":{"total":773094113280,"available":770638602240,"internally_reserved":0,"allocated":3350528,"data_stored":1963436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.998180"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667295+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:53:44.667295+0000","last_peered":"2023-10-06T03:53:44.667295+0000","last_clean":"2023-10-06T03:53:44.667295+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:53:44.667295+0000","last_undegraded":"2023-10-06T03:53:44.667295+0000","last_fullsized":"2023-10-06T03:53:44.667295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669973+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:53:44.669973+0000","last_peered":"2023-10-06T03:53:44.669973+0000","last_clean":"2023-10-06T03:53:44.669973+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:53:44.669973+0000","last_undegraded":"2023-10-06T03:53:44.669973+0000","last_fullsized":"2023-10-06T03:53:44.669973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669768+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:53:44.669768+0000","last_peered":"2023-10-06T03:53:44.669768+0000","last_clean":"2023-10-06T03:53:44.669768+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:53:44.669768+0000","last_undegraded":"2023-10-06T03:53:44.669768+0000","last_fullsized":"2023-10-06T03:53:44.669768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672480+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:53:44.672480+0000","last_peered":"2023-10-06T03:53:44.672480+0000","last_clean":"2023-10-06T03:53:44.672480+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:53:44.672480+0000","last_undegraded":"2023-10-06T03:53:44.672480+0000","last_fullsized":"2023-10-06T03:53:44.672480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673635+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:53:44.673635+0000","last_peered":"2023-10-06T03:53:44.673635+0000","last_clean":"2023-10-06T03:53:44.673635+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:53:44.673635+0000","last_undegraded":"2023-10-06T03:53:44.673635+0000","last_fullsized":"2023-10-06T03:53:44.673635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667704+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:53:44.667704+0000","last_peered":"2023-10-06T03:53:44.667704+0000","last_clean":"2023-10-06T03:53:44.667704+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:53:44.667704+0000","last_undegraded":"2023-10-06T03:53:44.667704+0000","last_fullsized":"2023-10-06T03:53:44.667704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666078+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:53:44.666078+0000","last_peered":"2023-10-06T03:53:44.666078+0000","last_clean":"2023-10-06T03:53:44.666078+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:53:44.666078+0000","last_undegraded":"2023-10-06T03:53:44.666078+0000","last_fullsized":"2023-10-06T03:53:44.666078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662039+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:53:44.662039+0000","last_peered":"2023-10-06T03:53:44.662039+0000","last_clean":"2023-10-06T03:53:44.662039+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:53:44.662039+0000","last_undegraded":"2023-10-06T03:53:44.662039+0000","last_fullsized":"2023-10-06T03:53:44.662039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681942+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:53:44.681942+0000","last_peered":"2023-10-06T03:53:44.681942+0000","last_clean":"2023-10-06T03:53:44.681942+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:53:44.681942+0000","last_undegraded":"2023-10-06T03:53:44.681942+0000","last_fullsized":"2023-10-06T03:53:44.681942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672263+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:53:44.672263+0000","last_peered":"2023-10-06T03:53:44.672263+0000","last_clean":"2023-10-06T03:53:44.672263+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:53:44.672263+0000","last_undegraded":"2023-10-06T03:53:44.672263+0000","last_fullsized":"2023-10-06T03:53:44.672263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668016+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:53:44.668016+0000","last_peered":"2023-10-06T03:53:44.668016+0000","last_clean":"2023-10-06T03:53:44.668016+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:53:44.668016+0000","last_undegraded":"2023-10-06T03:53:44.668016+0000","last_fullsized":"2023-10-06T03:53:44.668016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672653+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:53:44.672653+0000","last_peered":"2023-10-06T03:53:44.672653+0000","last_clean":"2023-10-06T03:53:44.672653+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:53:44.672653+0000","last_undegraded":"2023-10-06T03:53:44.672653+0000","last_fullsized":"2023-10-06T03:53:44.672653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672575+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:53:44.672575+0000","last_peered":"2023-10-06T03:53:44.672575+0000","last_clean":"2023-10-06T03:53:44.672575+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:53:44.672575+0000","last_undegraded":"2023-10-06T03:53:44.672575+0000","last_fullsized":"2023-10-06T03:53:44.672575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666949+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:53:44.666949+0000","last_peered":"2023-10-06T03:53:44.666949+0000","last_clean":"2023-10-06T03:53:44.666949+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:53:44.666949+0000","last_undegraded":"2023-10-06T03:53:44.666949+0000","last_fullsized":"2023-10-06T03:53:44.666949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666100+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:53:44.666100+0000","last_peered":"2023-10-06T03:53:44.666100+0000","last_clean":"2023-10-06T03:53:44.666100+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:53:44.666100+0000","last_undegraded":"2023-10-06T03:53:44.666100+0000","last_fullsized":"2023-10-06T03:53:44.666100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667627+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:53:44.667627+0000","last_peered":"2023-10-06T03:53:44.667627+0000","last_clean":"2023-10-06T03:53:44.667627+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:53:44.667627+0000","last_undegraded":"2023-10-06T03:53:44.667627+0000","last_fullsized":"2023-10-06T03:53:44.667627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681962+0000","last_change":"2023-10-06T03:53:44.668966+0000","last_active":"2023-10-06T03:53:44.681962+0000","last_peered":"2023-10-06T03:53:44.681962+0000","last_clean":"2023-10-06T03:53:44.681962+0000","last_became_active":"2023-10-06T03:53:44.668702+0000","last_became_peered":"2023-10-06T03:53:44.668702+0000","last_unstale":"2023-10-06T03:53:44.681962+0000","last_undegraded":"2023-10-06T03:53:44.681962+0000","last_fullsized":"2023-10-06T03:53:44.681962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669820+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:53:44.669820+0000","last_peered":"2023-10-06T03:53:44.669820+0000","last_clean":"2023-10-06T03:53:44.669820+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:53:44.669820+0000","last_undegraded":"2023-10-06T03:53:44.669820+0000","last_fullsized":"2023-10-06T03:53:44.669820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.677385+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:53:44.677385+0000","last_peered":"2023-10-06T03:53:44.677385+0000","last_clean":"2023-10-06T03:53:44.677385+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:53:44.677385+0000","last_undegraded":"2023-10-06T03:53:44.677385+0000","last_fullsized":"2023-10-06T03:53:44.677385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668754+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:53:44.668754+0000","last_peered":"2023-10-06T03:53:44.668754+0000","last_clean":"2023-10-06T03:53:44.668754+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:53:44.668754+0000","last_undegraded":"2023-10-06T03:53:44.668754+0000","last_fullsized":"2023-10-06T03:53:44.668754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.674299+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:53:44.674299+0000","last_peered":"2023-10-06T03:53:44.674299+0000","last_clean":"2023-10-06T03:53:44.674299+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:53:44.674299+0000","last_undegraded":"2023-10-06T03:53:44.674299+0000","last_fullsized":"2023-10-06T03:53:44.674299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673738+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:53:44.673738+0000","last_peered":"2023-10-06T03:53:44.673738+0000","last_clean":"2023-10-06T03:53:44.673738+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:53:44.673738+0000","last_undegraded":"2023-10-06T03:53:44.673738+0000","last_fullsized":"2023-10-06T03:53:44.673738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682049+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:53:44.682049+0000","last_peered":"2023-10-06T03:53:44.682049+0000","last_clean":"2023-10-06T03:53:44.682049+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:53:44.682049+0000","last_undegraded":"2023-10-06T03:53:44.682049+0000","last_fullsized":"2023-10-06T03:53:44.682049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665227+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:53:44.665227+0000","last_peered":"2023-10-06T03:53:44.665227+0000","last_clean":"2023-10-06T03:53:44.665227+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:53:44.665227+0000","last_undegraded":"2023-10-06T03:53:44.665227+0000","last_fullsized":"2023-10-06T03:53:44.665227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682382+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:53:44.682382+0000","last_peered":"2023-10-06T03:53:44.682382+0000","last_clean":"2023-10-06T03:53:44.682382+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:53:44.682382+0000","last_undegraded":"2023-10-06T03:53:44.682382+0000","last_fullsized":"2023-10-06T03:53:44.682382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682283+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:53:44.682283+0000","last_peered":"2023-10-06T03:53:44.682283+0000","last_clean":"2023-10-06T03:53:44.682283+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:53:44.682283+0000","last_undegraded":"2023-10-06T03:53:44.682283+0000","last_fullsized":"2023-10-06T03:53:44.682283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666993+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:53:44.666993+0000","last_peered":"2023-10-06T03:53:44.666993+0000","last_clean":"2023-10-06T03:53:44.666993+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:53:44.666993+0000","last_undegraded":"2023-10-06T03:53:44.666993+0000","last_fullsized":"2023-10-06T03:53:44.666993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672419+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:53:44.672419+0000","last_peered":"2023-10-06T03:53:44.672419+0000","last_clean":"2023-10-06T03:53:44.672419+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:53:44.672419+0000","last_undegraded":"2023-10-06T03:53:44.672419+0000","last_fullsized":"2023-10-06T03:53:44.672419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682075+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:53:44.682075+0000","last_peered":"2023-10-06T03:53:44.682075+0000","last_clean":"2023-10-06T03:53:44.682075+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:53:44.682075+0000","last_undegraded":"2023-10-06T03:53:44.682075+0000","last_fullsized":"2023-10-06T03:53:44.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670029+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:53:44.670029+0000","last_peered":"2023-10-06T03:53:44.670029+0000","last_clean":"2023-10-06T03:53:44.670029+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:53:44.670029+0000","last_undegraded":"2023-10-06T03:53:44.670029+0000","last_fullsized":"2023-10-06T03:53:44.670029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682028+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:53:44.682028+0000","last_peered":"2023-10-06T03:53:44.682028+0000","last_clean":"2023-10-06T03:53:44.682028+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:53:44.682028+0000","last_undegraded":"2023-10-06T03:53:44.682028+0000","last_fullsized":"2023-10-06T03:53:44.682028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673250+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:53:44.673250+0000","last_peered":"2023-10-06T03:53:44.673250+0000","last_clean":"2023-10-06T03:53:44.673250+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:53:44.673250+0000","last_undegraded":"2023-10-06T03:53:44.673250+0000","last_fullsized":"2023-10-06T03:53:44.673250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681786+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:53:44.681786+0000","last_peered":"2023-10-06T03:53:44.681786+0000","last_clean":"2023-10-06T03:53:44.681786+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:53:44.681786+0000","last_undegraded":"2023-10-06T03:53:44.681786+0000","last_fullsized":"2023-10-06T03:53:44.681786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668742+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:53:44.668742+0000","last_peered":"2023-10-06T03:53:44.668742+0000","last_clean":"2023-10-06T03:53:44.668742+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:53:44.668742+0000","last_undegraded":"2023-10-06T03:53:44.668742+0000","last_fullsized":"2023-10-06T03:53:44.668742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665811+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:53:44.665811+0000","last_peered":"2023-10-06T03:53:44.665811+0000","last_clean":"2023-10-06T03:53:44.665811+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:53:44.665811+0000","last_undegraded":"2023-10-06T03:53:44.665811+0000","last_fullsized":"2023-10-06T03:53:44.665811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652602+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:53:44.652602+0000","last_peered":"2023-10-06T03:53:44.652602+0000","last_clean":"2023-10-06T03:53:44.652602+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:53:44.652602+0000","last_undegraded":"2023-10-06T03:53:44.652602+0000","last_fullsized":"2023-10-06T03:53:44.652602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681806+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:53:44.681806+0000","last_peered":"2023-10-06T03:53:44.681806+0000","last_clean":"2023-10-06T03:53:44.681806+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:53:44.681806+0000","last_undegraded":"2023-10-06T03:53:44.681806+0000","last_fullsized":"2023-10-06T03:53:44.681806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652557+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:53:44.652557+0000","last_peered":"2023-10-06T03:53:44.652557+0000","last_clean":"2023-10-06T03:53:44.652557+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:53:44.652557+0000","last_undegraded":"2023-10-06T03:53:44.652557+0000","last_fullsized":"2023-10-06T03:53:44.652557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673546+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:53:44.673546+0000","last_peered":"2023-10-06T03:53:44.673546+0000","last_clean":"2023-10-06T03:53:44.673546+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:53:44.673546+0000","last_undegraded":"2023-10-06T03:53:44.673546+0000","last_fullsized":"2023-10-06T03:53:44.673546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673337+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:53:44.673337+0000","last_peered":"2023-10-06T03:53:44.673337+0000","last_clean":"2023-10-06T03:53:44.673337+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:53:44.673337+0000","last_undegraded":"2023-10-06T03:53:44.673337+0000","last_fullsized":"2023-10-06T03:53:44.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667802+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:53:44.667802+0000","last_peered":"2023-10-06T03:53:44.667802+0000","last_clean":"2023-10-06T03:53:44.667802+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:53:44.667802+0000","last_undegraded":"2023-10-06T03:53:44.667802+0000","last_fullsized":"2023-10-06T03:53:44.667802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662057+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:53:44.662057+0000","last_peered":"2023-10-06T03:53:44.662057+0000","last_clean":"2023-10-06T03:53:44.662057+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:53:44.662057+0000","last_undegraded":"2023-10-06T03:53:44.662057+0000","last_fullsized":"2023-10-06T03:53:44.662057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668273+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:53:44.668273+0000","last_peered":"2023-10-06T03:53:44.668273+0000","last_clean":"2023-10-06T03:53:44.668273+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:53:44.668273+0000","last_undegraded":"2023-10-06T03:53:44.668273+0000","last_fullsized":"2023-10-06T03:53:44.668273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670120+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:53:44.670120+0000","last_peered":"2023-10-06T03:53:44.670120+0000","last_clean":"2023-10-06T03:53:44.670120+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:53:44.670120+0000","last_undegraded":"2023-10-06T03:53:44.670120+0000","last_fullsized":"2023-10-06T03:53:44.670120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661720+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:53:44.661720+0000","last_peered":"2023-10-06T03:53:44.661720+0000","last_clean":"2023-10-06T03:53:44.661720+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:53:44.661720+0000","last_undegraded":"2023-10-06T03:53:44.661720+0000","last_fullsized":"2023-10-06T03:53:44.661720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673307+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:53:44.673307+0000","last_peered":"2023-10-06T03:53:44.673307+0000","last_clean":"2023-10-06T03:53:44.673307+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:53:44.673307+0000","last_undegraded":"2023-10-06T03:53:44.673307+0000","last_fullsized":"2023-10-06T03:53:44.673307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642704+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:53:44.642704+0000","last_peered":"2023-10-06T03:53:44.642704+0000","last_clean":"2023-10-06T03:53:44.642704+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:53:44.642704+0000","last_undegraded":"2023-10-06T03:53:44.642704+0000","last_fullsized":"2023-10-06T03:53:44.642704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681727+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:53:44.681727+0000","last_peered":"2023-10-06T03:53:44.681727+0000","last_clean":"2023-10-06T03:53:44.681727+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:53:44.681727+0000","last_undegraded":"2023-10-06T03:53:44.681727+0000","last_fullsized":"2023-10-06T03:53:44.681727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673004+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:53:44.673004+0000","last_peered":"2023-10-06T03:53:44.673004+0000","last_clean":"2023-10-06T03:53:44.673004+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:53:44.673004+0000","last_undegraded":"2023-10-06T03:53:44.673004+0000","last_fullsized":"2023-10-06T03:53:44.673004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668734+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:53:44.668734+0000","last_peered":"2023-10-06T03:53:44.668734+0000","last_clean":"2023-10-06T03:53:44.668734+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:53:44.668734+0000","last_undegraded":"2023-10-06T03:53:44.668734+0000","last_fullsized":"2023-10-06T03:53:44.668734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651174+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:53:44.651174+0000","last_peered":"2023-10-06T03:53:44.651174+0000","last_clean":"2023-10-06T03:53:44.651174+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:53:44.651174+0000","last_undegraded":"2023-10-06T03:53:44.651174+0000","last_fullsized":"2023-10-06T03:53:44.651174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669955+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:53:44.669955+0000","last_peered":"2023-10-06T03:53:44.669955+0000","last_clean":"2023-10-06T03:53:44.669955+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:53:44.669955+0000","last_undegraded":"2023-10-06T03:53:44.669955+0000","last_fullsized":"2023-10-06T03:53:44.669955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.638833+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:53:44.638833+0000","last_peered":"2023-10-06T03:53:44.638833+0000","last_clean":"2023-10-06T03:53:44.638833+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:53:44.638833+0000","last_undegraded":"2023-10-06T03:53:44.638833+0000","last_fullsized":"2023-10-06T03:53:44.638833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669986+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:53:44.669986+0000","last_peered":"2023-10-06T03:53:44.669986+0000","last_clean":"2023-10-06T03:53:44.669986+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:53:44.669986+0000","last_undegraded":"2023-10-06T03:53:44.669986+0000","last_fullsized":"2023-10-06T03:53:44.669986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642295+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:53:44.642295+0000","last_peered":"2023-10-06T03:53:44.642295+0000","last_clean":"2023-10-06T03:53:44.642295+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:53:44.642295+0000","last_undegraded":"2023-10-06T03:53:44.642295+0000","last_fullsized":"2023-10-06T03:53:44.642295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682133+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:53:44.682133+0000","last_peered":"2023-10-06T03:53:44.682133+0000","last_clean":"2023-10-06T03:53:44.682133+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:53:44.682133+0000","last_undegraded":"2023-10-06T03:53:44.682133+0000","last_fullsized":"2023-10-06T03:53:44.682133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652684+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:53:44.652684+0000","last_peered":"2023-10-06T03:53:44.652684+0000","last_clean":"2023-10-06T03:53:44.652684+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:53:44.652684+0000","last_undegraded":"2023-10-06T03:53:44.652684+0000","last_fullsized":"2023-10-06T03:53:44.652684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641956+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:53:44.641956+0000","last_peered":"2023-10-06T03:53:44.641956+0000","last_clean":"2023-10-06T03:53:44.641956+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:53:44.641956+0000","last_undegraded":"2023-10-06T03:53:44.641956+0000","last_fullsized":"2023-10-06T03:53:44.641956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.643279+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:53:44.643279+0000","last_peered":"2023-10-06T03:53:44.643279+0000","last_clean":"2023-10-06T03:53:44.643279+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:53:44.643279+0000","last_undegraded":"2023-10-06T03:53:44.643279+0000","last_fullsized":"2023-10-06T03:53:44.643279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672060+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:53:44.672060+0000","last_peered":"2023-10-06T03:53:44.672060+0000","last_clean":"2023-10-06T03:53:44.672060+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:53:44.672060+0000","last_undegraded":"2023-10-06T03:53:44.672060+0000","last_fullsized":"2023-10-06T03:53:44.672060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651771+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:53:44.651771+0000","last_peered":"2023-10-06T03:53:44.651771+0000","last_clean":"2023-10-06T03:53:44.651771+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:53:44.651771+0000","last_undegraded":"2023-10-06T03:53:44.651771+0000","last_fullsized":"2023-10-06T03:53:44.651771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652194+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:53:44.652194+0000","last_peered":"2023-10-06T03:53:44.652194+0000","last_clean":"2023-10-06T03:53:44.652194+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:53:44.652194+0000","last_undegraded":"2023-10-06T03:53:44.652194+0000","last_fullsized":"2023-10-06T03:53:44.652194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673823+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:53:44.673823+0000","last_peered":"2023-10-06T03:53:44.673823+0000","last_clean":"2023-10-06T03:53:44.673823+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:53:44.673823+0000","last_undegraded":"2023-10-06T03:53:44.673823+0000","last_fullsized":"2023-10-06T03:53:44.673823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652382+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:53:44.652382+0000","last_peered":"2023-10-06T03:53:44.652382+0000","last_clean":"2023-10-06T03:53:44.652382+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:53:44.652382+0000","last_undegraded":"2023-10-06T03:53:44.652382+0000","last_fullsized":"2023-10-06T03:53:44.652382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644523+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:53:44.644523+0000","last_peered":"2023-10-06T03:53:44.644523+0000","last_clean":"2023-10-06T03:53:44.644523+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:53:44.644523+0000","last_undegraded":"2023-10-06T03:53:44.644523+0000","last_fullsized":"2023-10-06T03:53:44.644523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670663+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:53:44.670663+0000","last_peered":"2023-10-06T03:53:44.670663+0000","last_clean":"2023-10-06T03:53:44.670663+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:53:44.670663+0000","last_undegraded":"2023-10-06T03:53:44.670663+0000","last_fullsized":"2023-10-06T03:53:44.670663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644267+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:53:44.644267+0000","last_peered":"2023-10-06T03:53:44.644267+0000","last_clean":"2023-10-06T03:53:44.644267+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:53:44.644267+0000","last_undegraded":"2023-10-06T03:53:44.644267+0000","last_fullsized":"2023-10-06T03:53:44.644267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641446+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:53:44.641446+0000","last_peered":"2023-10-06T03:53:44.641446+0000","last_clean":"2023-10-06T03:53:44.641446+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:53:44.641446+0000","last_undegraded":"2023-10-06T03:53:44.641446+0000","last_fullsized":"2023-10-06T03:53:44.641446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682392+0000","last_change":"2023-10-06T03:53:44.672856+0000","last_active":"2023-10-06T03:53:44.682392+0000","last_peered":"2023-10-06T03:53:44.682392+0000","last_clean":"2023-10-06T03:53:44.682392+0000","last_became_active":"2023-10-06T03:53:44.670507+0000","last_became_peered":"2023-10-06T03:53:44.670507+0000","last_unstale":"2023-10-06T03:53:44.682392+0000","last_undegraded":"2023-10-06T03:53:44.682392+0000","last_fullsized":"2023-10-06T03:53:44.682392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644465+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:53:44.644465+0000","last_peered":"2023-10-06T03:53:44.644465+0000","last_clean":"2023-10-06T03:53:44.644465+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:53:44.644465+0000","last_undegraded":"2023-10-06T03:53:44.644465+0000","last_fullsized":"2023-10-06T03:53:44.644465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.649711+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:53:44.649711+0000","last_peered":"2023-10-06T03:53:44.649711+0000","last_clean":"2023-10-06T03:53:44.649711+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:53:44.649711+0000","last_undegraded":"2023-10-06T03:53:44.649711+0000","last_fullsized":"2023-10-06T03:53:44.649711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670177+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:53:44.670177+0000","last_peered":"2023-10-06T03:53:44.670177+0000","last_clean":"2023-10-06T03:53:44.670177+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:53:44.670177+0000","last_undegraded":"2023-10-06T03:53:44.670177+0000","last_fullsized":"2023-10-06T03:53:44.670177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.649894+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:53:44.649894+0000","last_peered":"2023-10-06T03:53:44.649894+0000","last_clean":"2023-10-06T03:53:44.649894+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:53:44.649894+0000","last_undegraded":"2023-10-06T03:53:44.649894+0000","last_fullsized":"2023-10-06T03:53:44.649894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655203+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:53:44.655203+0000","last_peered":"2023-10-06T03:53:44.655203+0000","last_clean":"2023-10-06T03:53:44.655203+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:53:44.655203+0000","last_undegraded":"2023-10-06T03:53:44.655203+0000","last_fullsized":"2023-10-06T03:53:44.655203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681705+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:53:44.681705+0000","last_peered":"2023-10-06T03:53:44.681705+0000","last_clean":"2023-10-06T03:53:44.681705+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:53:44.681705+0000","last_undegraded":"2023-10-06T03:53:44.681705+0000","last_fullsized":"2023-10-06T03:53:44.681705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662120+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:53:44.662120+0000","last_peered":"2023-10-06T03:53:44.662120+0000","last_clean":"2023-10-06T03:53:44.662120+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:53:44.662120+0000","last_undegraded":"2023-10-06T03:53:44.662120+0000","last_fullsized":"2023-10-06T03:53:44.662120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644308+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:53:44.644308+0000","last_peered":"2023-10-06T03:53:44.644308+0000","last_clean":"2023-10-06T03:53:44.644308+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:53:44.644308+0000","last_undegraded":"2023-10-06T03:53:44.644308+0000","last_fullsized":"2023-10-06T03:53:44.644308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670632+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:53:44.670632+0000","last_peered":"2023-10-06T03:53:44.670632+0000","last_clean":"2023-10-06T03:53:44.670632+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:53:44.670632+0000","last_undegraded":"2023-10-06T03:53:44.670632+0000","last_fullsized":"2023-10-06T03:53:44.670632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:53:46.838440+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:53:46.838440+0000","last_peered":"2023-10-06T03:53:46.838440+0000","last_clean":"2023-10-06T03:53:46.838440+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:53:46.838440+0000","last_undegraded":"2023-10-06T03:53:46.838440+0000","last_fullsized":"2023-10-06T03:53:46.838440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651572+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:53:44.651572+0000","last_peered":"2023-10-06T03:53:44.651572+0000","last_clean":"2023-10-06T03:53:44.651572+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:53:44.651572+0000","last_undegraded":"2023-10-06T03:53:44.651572+0000","last_fullsized":"2023-10-06T03:53:44.651572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654585+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:53:44.654585+0000","last_peered":"2023-10-06T03:53:44.654585+0000","last_clean":"2023-10-06T03:53:44.654585+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:53:44.654585+0000","last_undegraded":"2023-10-06T03:53:44.654585+0000","last_fullsized":"2023-10-06T03:53:44.654585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668210+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:53:44.668210+0000","last_peered":"2023-10-06T03:53:44.668210+0000","last_clean":"2023-10-06T03:53:44.668210+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:53:44.668210+0000","last_undegraded":"2023-10-06T03:53:44.668210+0000","last_fullsized":"2023-10-06T03:53:44.668210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672268+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:53:44.672268+0000","last_peered":"2023-10-06T03:53:44.672268+0000","last_clean":"2023-10-06T03:53:44.672268+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:53:44.672268+0000","last_undegraded":"2023-10-06T03:53:44.672268+0000","last_fullsized":"2023-10-06T03:53:44.672268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682362+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:53:44.682362+0000","last_peered":"2023-10-06T03:53:44.682362+0000","last_clean":"2023-10-06T03:53:44.682362+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:53:44.682362+0000","last_undegraded":"2023-10-06T03:53:44.682362+0000","last_fullsized":"2023-10-06T03:53:44.682362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672974+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:53:44.672974+0000","last_peered":"2023-10-06T03:53:44.672974+0000","last_clean":"2023-10-06T03:53:44.672974+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:53:44.672974+0000","last_undegraded":"2023-10-06T03:53:44.672974+0000","last_fullsized":"2023-10-06T03:53:44.672974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644490+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:53:44.644490+0000","last_peered":"2023-10-06T03:53:44.644490+0000","last_clean":"2023-10-06T03:53:44.644490+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:53:44.644490+0000","last_undegraded":"2023-10-06T03:53:44.644490+0000","last_fullsized":"2023-10-06T03:53:44.644490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681914+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:53:44.681914+0000","last_peered":"2023-10-06T03:53:44.681914+0000","last_clean":"2023-10-06T03:53:44.681914+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:53:44.681914+0000","last_undegraded":"2023-10-06T03:53:44.681914+0000","last_fullsized":"2023-10-06T03:53:44.681914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654947+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:53:44.654947+0000","last_peered":"2023-10-06T03:53:44.654947+0000","last_clean":"2023-10-06T03:53:44.654947+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:53:44.654947+0000","last_undegraded":"2023-10-06T03:53:44.654947+0000","last_fullsized":"2023-10-06T03:53:44.654947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673706+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:53:44.673706+0000","last_peered":"2023-10-06T03:53:44.673706+0000","last_clean":"2023-10-06T03:53:44.673706+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:53:44.673706+0000","last_undegraded":"2023-10-06T03:53:44.673706+0000","last_fullsized":"2023-10-06T03:53:44.673706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672261+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:53:44.672261+0000","last_peered":"2023-10-06T03:53:44.672261+0000","last_clean":"2023-10-06T03:53:44.672261+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:53:44.672261+0000","last_undegraded":"2023-10-06T03:53:44.672261+0000","last_fullsized":"2023-10-06T03:53:44.672261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642090+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:53:44.642090+0000","last_peered":"2023-10-06T03:53:44.642090+0000","last_clean":"2023-10-06T03:53:44.642090+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:53:44.642090+0000","last_undegraded":"2023-10-06T03:53:44.642090+0000","last_fullsized":"2023-10-06T03:53:44.642090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681679+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:53:44.681679+0000","last_peered":"2023-10-06T03:53:44.681679+0000","last_clean":"2023-10-06T03:53:44.681679+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:53:44.681679+0000","last_undegraded":"2023-10-06T03:53:44.681679+0000","last_fullsized":"2023-10-06T03:53:44.681679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.648972+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:53:44.648972+0000","last_peered":"2023-10-06T03:53:44.648972+0000","last_clean":"2023-10-06T03:53:44.648972+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:53:44.648972+0000","last_undegraded":"2023-10-06T03:53:44.648972+0000","last_fullsized":"2023-10-06T03:53:44.648972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673553+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:53:44.673553+0000","last_peered":"2023-10-06T03:53:44.673553+0000","last_clean":"2023-10-06T03:53:44.673553+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:53:44.673553+0000","last_undegraded":"2023-10-06T03:53:44.673553+0000","last_fullsized":"2023-10-06T03:53:44.673553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660417+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:53:44.660417+0000","last_peered":"2023-10-06T03:53:44.660417+0000","last_clean":"2023-10-06T03:53:44.660417+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:53:44.660417+0000","last_undegraded":"2023-10-06T03:53:44.660417+0000","last_fullsized":"2023-10-06T03:53:44.660417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672673+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:53:44.672673+0000","last_peered":"2023-10-06T03:53:44.672673+0000","last_clean":"2023-10-06T03:53:44.672673+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:53:44.672673+0000","last_undegraded":"2023-10-06T03:53:44.672673+0000","last_fullsized":"2023-10-06T03:53:44.672673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659382+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:53:44.659382+0000","last_peered":"2023-10-06T03:53:44.659382+0000","last_clean":"2023-10-06T03:53:44.659382+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:53:44.659382+0000","last_undegraded":"2023-10-06T03:53:44.659382+0000","last_fullsized":"2023-10-06T03:53:44.659382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667758+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:53:44.667758+0000","last_peered":"2023-10-06T03:53:44.667758+0000","last_clean":"2023-10-06T03:53:44.667758+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:53:44.667758+0000","last_undegraded":"2023-10-06T03:53:44.667758+0000","last_fullsized":"2023-10-06T03:53:44.667758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.657092+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:53:44.657092+0000","last_peered":"2023-10-06T03:53:44.657092+0000","last_clean":"2023-10-06T03:53:44.657092+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:53:44.657092+0000","last_undegraded":"2023-10-06T03:53:44.657092+0000","last_fullsized":"2023-10-06T03:53:44.657092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667741+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:53:44.667741+0000","last_peered":"2023-10-06T03:53:44.667741+0000","last_clean":"2023-10-06T03:53:44.667741+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:53:44.667741+0000","last_undegraded":"2023-10-06T03:53:44.667741+0000","last_fullsized":"2023-10-06T03:53:44.667741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655893+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:53:44.655893+0000","last_peered":"2023-10-06T03:53:44.655893+0000","last_clean":"2023-10-06T03:53:44.655893+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:53:44.655893+0000","last_undegraded":"2023-10-06T03:53:44.655893+0000","last_fullsized":"2023-10-06T03:53:44.655893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661741+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:53:44.661741+0000","last_peered":"2023-10-06T03:53:44.661741+0000","last_clean":"2023-10-06T03:53:44.661741+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:53:44.661741+0000","last_undegraded":"2023-10-06T03:53:44.661741+0000","last_fullsized":"2023-10-06T03:53:44.661741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670951+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:53:44.670951+0000","last_peered":"2023-10-06T03:53:44.670951+0000","last_clean":"2023-10-06T03:53:44.670951+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:53:44.670951+0000","last_undegraded":"2023-10-06T03:53:44.670951+0000","last_fullsized":"2023-10-06T03:53:44.670951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669987+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:53:44.669987+0000","last_peered":"2023-10-06T03:53:44.669987+0000","last_clean":"2023-10-06T03:53:44.669987+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:53:44.669987+0000","last_undegraded":"2023-10-06T03:53:44.669987+0000","last_fullsized":"2023-10-06T03:53:44.669987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673850+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:53:44.673850+0000","last_peered":"2023-10-06T03:53:44.673850+0000","last_clean":"2023-10-06T03:53:44.673850+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:53:44.673850+0000","last_undegraded":"2023-10-06T03:53:44.673850+0000","last_fullsized":"2023-10-06T03:53:44.673850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":689381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":97885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":282624,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":97351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":688183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:53:52.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:53:52.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 Processor -- start 2023-10-06T03:53:52.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- start start 2023-10-06T03:53:52.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52f806bfc0 0x7f52f80b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f8069870 con 0x7f52f80b18f0 2023-10-06T03:53:52.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f8068a20 con 0x7f52f80b1470 2023-10-06T03:53:52.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f80b3150 con 0x7f52f806bfc0 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f52f80b18f0 0x7f52f80b7180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34652/0 (socket says 172.21.15.57:34652) 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f6d9d700 1 -- 172.21.15.57:0/393670368 learned_addr learned my addr 172.21.15.57:0/393670368 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f659c700 1 --2- 172.21.15.57:0/393670368 >> v2:172.21.15.105:3300/0 conn(0x7f52f806bfc0 0x7f52f80b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f559a700 1 -- 172.21.15.57:0/393670368 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621320909 0 0) 0x7f52f8069870 con 0x7f52f80b18f0 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f559a700 1 -- 172.21.15.57:0/393670368 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4003570 con 0x7f52f80b18f0 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f659c700 1 -- 172.21.15.57:0/393670368 >> v1:172.21.15.105:6789/0 conn(0x7f52f80b1470 legacy=0x7f52f80b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f659c700 1 -- 172.21.15.57:0/393670368 >> v1:172.21.15.57:6789/0 conn(0x7f52f80b18f0 legacy=0x7f52f80b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.369 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f659c700 1 -- 172.21.15.57:0/393670368 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f80b7890 con 0x7f52f806bfc0 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f659c700 1 --2- 172.21.15.57:0/393670368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f806bfc0 0x7f52f80b2920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009910 tx=0x7f52e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57279bd9f634fb03 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f559a700 1 -- 172.21.15.57:0/393670368 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000b640 con 0x7f52f806bfc0 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f559a700 1 -- 172.21.15.57:0/393670368 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e000b7a0 con 0x7f52f806bfc0 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52f559a700 1 -- 172.21.15.57:0/393670368 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000bb20 con 0x7f52f806bfc0 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- 172.21.15.57:0/393670368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f806bfc0 msgr2=0x7f52f80b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 --2- 172.21.15.57:0/393670368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f806bfc0 0x7f52f80b2920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009910 tx=0x7f52e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- 172.21.15.57:0/393670368 shutdown_connections 2023-10-06T03:53:52.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 --2- 172.21.15.57:0/393670368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f806bfc0 0x7f52f80b2920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.363+0000 7f52fca22700 1 -- 172.21.15.57:0/393670368 >> 172.21.15.57:0/393670368 conn(0x7f52f8067070 msgr2=0x7f52f8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- 172.21.15.57:0/393670368 shutdown_connections 2023-10-06T03:53:52.371 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- 172.21.15.57:0/393670368 wait complete. 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 Processor -- start 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- start start 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f80b1470 0x7f52f814b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f80b18f0 0x7f52f814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f814c9b0 con 0x7f52f806bfc0 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f815a370 con 0x7f52f80b1470 2023-10-06T03:53:52.373 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f80a4650 con 0x7f52f80b18f0 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45984/0 (socket says 172.21.15.57:45984) 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 -- 172.21.15.57:0/3163781771 learned_addr learned my addr 172.21.15.57:0/3163781771 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f6d9d700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f80b18f0 0x7f52f814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f5d9b700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f80b1470 0x7f52f814b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 -- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f80b18f0 msgr2=0x7f52f814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f80b18f0 0x7f52f814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 -- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f80b1470 msgr2=0x7f52f814b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f80b1470 0x7f52f814b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 -- 172.21.15.57:0/3163781771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0009420 con 0x7f52f806bfc0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52f659c700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52e00093f0 tx=0x7f52e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e001f070 con 0x7f52f806bfc0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e000b910 con 0x7f52f806bfc0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f8159d20 con 0x7f52f806bfc0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0011690 con 0x7f52f806bfc0 2023-10-06T03:53:52.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.367+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f814bbf0 con 0x7f52f806bfc0 2023-10-06T03:53:52.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f814bde0 con 0x7f52f806bfc0 2023-10-06T03:53:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f52e0011a40 con 0x7f52f806bfc0 2023-10-06T03:53:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52ee7fc700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 0x7f52d8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52e007dc60 con 0x7f52f806bfc0 2023-10-06T03:53:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52f5d9b700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 0x7f52d8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.377 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.371+0000 7f52f5d9b700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 0x7f52d8062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52f81453b0 tx=0x7f52f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.379+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f52e004e0f0 con 0x7f52f806bfc0 2023-10-06T03:53:52.537 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.531+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52f815a1a0 con 0x7f52d8060550 2023-10-06T03:53:52.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.551+0000 7f52ee7fc700 1 -- 172.21.15.57:0/3163781771 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286458 (secure 0 0 0) 0x7f52f0003bd0 con 0x7f52d8060550 2023-10-06T03:53:52.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:52.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 msgr2=0x7f52d8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 0x7f52d8062a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52f81453b0 tx=0x7f52f0009040 comp rx=0 tx=0).stop 2023-10-06T03:53:52.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 msgr2=0x7f52f8159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52e00093f0 tx=0x7f52e0017000 comp rx=0 tx=0).stop 2023-10-06T03:53:52.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 shutdown_connections 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f52d8060550 0x7f52d8062a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f80b18f0 0x7f52f814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f80b1470 0x7f52f814b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 --2- 172.21.15.57:0/3163781771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52f806bfc0 0x7f52f8159650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 >> 172.21.15.57:0/3163781771 conn(0x7f52f8067070 msgr2=0x7f52f8143670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 shutdown_connections 2023-10-06T03:53:52.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.555+0000 7f52fca22700 1 -- 172.21.15.57:0/3163781771 wait complete. 2023-10-06T03:53:52.563 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:53:52.573 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-06T03:53:50.625632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397960,"kb_used_data":3272,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752576760,"statfs":{"total":773094113280,"available":770638602240,"internally_reserved":0,"allocated":3350528,"data_stored":1963436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.998180"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667295+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:53:44.667295+0000","last_peered":"2023-10-06T03:53:44.667295+0000","last_clean":"2023-10-06T03:53:44.667295+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:53:44.667295+0000","last_undegraded":"2023-10-06T03:53:44.667295+0000","last_fullsized":"2023-10-06T03:53:44.667295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669973+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:53:44.669973+0000","last_peered":"2023-10-06T03:53:44.669973+0000","last_clean":"2023-10-06T03:53:44.669973+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:53:44.669973+0000","last_undegraded":"2023-10-06T03:53:44.669973+0000","last_fullsized":"2023-10-06T03:53:44.669973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669768+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:53:44.669768+0000","last_peered":"2023-10-06T03:53:44.669768+0000","last_clean":"2023-10-06T03:53:44.669768+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:53:44.669768+0000","last_undegraded":"2023-10-06T03:53:44.669768+0000","last_fullsized":"2023-10-06T03:53:44.669768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672480+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:53:44.672480+0000","last_peered":"2023-10-06T03:53:44.672480+0000","last_clean":"2023-10-06T03:53:44.672480+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:53:44.672480+0000","last_undegraded":"2023-10-06T03:53:44.672480+0000","last_fullsized":"2023-10-06T03:53:44.672480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673635+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:53:44.673635+0000","last_peered":"2023-10-06T03:53:44.673635+0000","last_clean":"2023-10-06T03:53:44.673635+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:53:44.673635+0000","last_undegraded":"2023-10-06T03:53:44.673635+0000","last_fullsized":"2023-10-06T03:53:44.673635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667704+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:53:44.667704+0000","last_peered":"2023-10-06T03:53:44.667704+0000","last_clean":"2023-10-06T03:53:44.667704+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:53:44.667704+0000","last_undegraded":"2023-10-06T03:53:44.667704+0000","last_fullsized":"2023-10-06T03:53:44.667704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666078+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:53:44.666078+0000","last_peered":"2023-10-06T03:53:44.666078+0000","last_clean":"2023-10-06T03:53:44.666078+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:53:44.666078+0000","last_undegraded":"2023-10-06T03:53:44.666078+0000","last_fullsized":"2023-10-06T03:53:44.666078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662039+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:53:44.662039+0000","last_peered":"2023-10-06T03:53:44.662039+0000","last_clean":"2023-10-06T03:53:44.662039+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:53:44.662039+0000","last_undegraded":"2023-10-06T03:53:44.662039+0000","last_fullsized":"2023-10-06T03:53:44.662039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681942+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:53:44.681942+0000","last_peered":"2023-10-06T03:53:44.681942+0000","last_clean":"2023-10-06T03:53:44.681942+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:53:44.681942+0000","last_undegraded":"2023-10-06T03:53:44.681942+0000","last_fullsized":"2023-10-06T03:53:44.681942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672263+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:53:44.672263+0000","last_peered":"2023-10-06T03:53:44.672263+0000","last_clean":"2023-10-06T03:53:44.672263+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:53:44.672263+0000","last_undegraded":"2023-10-06T03:53:44.672263+0000","last_fullsized":"2023-10-06T03:53:44.672263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668016+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:53:44.668016+0000","last_peered":"2023-10-06T03:53:44.668016+0000","last_clean":"2023-10-06T03:53:44.668016+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:53:44.668016+0000","last_undegraded":"2023-10-06T03:53:44.668016+0000","last_fullsized":"2023-10-06T03:53:44.668016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672653+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:53:44.672653+0000","last_peered":"2023-10-06T03:53:44.672653+0000","last_clean":"2023-10-06T03:53:44.672653+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:53:44.672653+0000","last_undegraded":"2023-10-06T03:53:44.672653+0000","last_fullsized":"2023-10-06T03:53:44.672653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672575+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:53:44.672575+0000","last_peered":"2023-10-06T03:53:44.672575+0000","last_clean":"2023-10-06T03:53:44.672575+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:53:44.672575+0000","last_undegraded":"2023-10-06T03:53:44.672575+0000","last_fullsized":"2023-10-06T03:53:44.672575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666949+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:53:44.666949+0000","last_peered":"2023-10-06T03:53:44.666949+0000","last_clean":"2023-10-06T03:53:44.666949+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:53:44.666949+0000","last_undegraded":"2023-10-06T03:53:44.666949+0000","last_fullsized":"2023-10-06T03:53:44.666949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666100+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:53:44.666100+0000","last_peered":"2023-10-06T03:53:44.666100+0000","last_clean":"2023-10-06T03:53:44.666100+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:53:44.666100+0000","last_undegraded":"2023-10-06T03:53:44.666100+0000","last_fullsized":"2023-10-06T03:53:44.666100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667627+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:53:44.667627+0000","last_peered":"2023-10-06T03:53:44.667627+0000","last_clean":"2023-10-06T03:53:44.667627+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:53:44.667627+0000","last_undegraded":"2023-10-06T03:53:44.667627+0000","last_fullsized":"2023-10-06T03:53:44.667627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681962+0000","last_change":"2023-10-06T03:53:44.668966+0000","last_active":"2023-10-06T03:53:44.681962+0000","last_peered":"2023-10-06T03:53:44.681962+0000","last_clean":"2023-10-06T03:53:44.681962+0000","last_became_active":"2023-10-06T03:53:44.668702+0000","last_became_peered":"2023-10-06T03:53:44.668702+0000","last_unstale":"2023-10-06T03:53:44.681962+0000","last_undegraded":"2023-10-06T03:53:44.681962+0000","last_fullsized":"2023-10-06T03:53:44.681962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669820+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:53:44.669820+0000","last_peered":"2023-10-06T03:53:44.669820+0000","last_clean":"2023-10-06T03:53:44.669820+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:53:44.669820+0000","last_undegraded":"2023-10-06T03:53:44.669820+0000","last_fullsized":"2023-10-06T03:53:44.669820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.677385+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:53:44.677385+0000","last_peered":"2023-10-06T03:53:44.677385+0000","last_clean":"2023-10-06T03:53:44.677385+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:53:44.677385+0000","last_undegraded":"2023-10-06T03:53:44.677385+0000","last_fullsized":"2023-10-06T03:53:44.677385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668754+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:53:44.668754+0000","last_peered":"2023-10-06T03:53:44.668754+0000","last_clean":"2023-10-06T03:53:44.668754+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:53:44.668754+0000","last_undegraded":"2023-10-06T03:53:44.668754+0000","last_fullsized":"2023-10-06T03:53:44.668754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.674299+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:53:44.674299+0000","last_peered":"2023-10-06T03:53:44.674299+0000","last_clean":"2023-10-06T03:53:44.674299+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:53:44.674299+0000","last_undegraded":"2023-10-06T03:53:44.674299+0000","last_fullsized":"2023-10-06T03:53:44.674299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673738+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:53:44.673738+0000","last_peered":"2023-10-06T03:53:44.673738+0000","last_clean":"2023-10-06T03:53:44.673738+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:53:44.673738+0000","last_undegraded":"2023-10-06T03:53:44.673738+0000","last_fullsized":"2023-10-06T03:53:44.673738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682049+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:53:44.682049+0000","last_peered":"2023-10-06T03:53:44.682049+0000","last_clean":"2023-10-06T03:53:44.682049+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:53:44.682049+0000","last_undegraded":"2023-10-06T03:53:44.682049+0000","last_fullsized":"2023-10-06T03:53:44.682049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665227+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:53:44.665227+0000","last_peered":"2023-10-06T03:53:44.665227+0000","last_clean":"2023-10-06T03:53:44.665227+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:53:44.665227+0000","last_undegraded":"2023-10-06T03:53:44.665227+0000","last_fullsized":"2023-10-06T03:53:44.665227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682382+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:53:44.682382+0000","last_peered":"2023-10-06T03:53:44.682382+0000","last_clean":"2023-10-06T03:53:44.682382+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:53:44.682382+0000","last_undegraded":"2023-10-06T03:53:44.682382+0000","last_fullsized":"2023-10-06T03:53:44.682382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682283+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:53:44.682283+0000","last_peered":"2023-10-06T03:53:44.682283+0000","last_clean":"2023-10-06T03:53:44.682283+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:53:44.682283+0000","last_undegraded":"2023-10-06T03:53:44.682283+0000","last_fullsized":"2023-10-06T03:53:44.682283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.666993+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:53:44.666993+0000","last_peered":"2023-10-06T03:53:44.666993+0000","last_clean":"2023-10-06T03:53:44.666993+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:53:44.666993+0000","last_undegraded":"2023-10-06T03:53:44.666993+0000","last_fullsized":"2023-10-06T03:53:44.666993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672419+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:53:44.672419+0000","last_peered":"2023-10-06T03:53:44.672419+0000","last_clean":"2023-10-06T03:53:44.672419+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:53:44.672419+0000","last_undegraded":"2023-10-06T03:53:44.672419+0000","last_fullsized":"2023-10-06T03:53:44.672419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682075+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:53:44.682075+0000","last_peered":"2023-10-06T03:53:44.682075+0000","last_clean":"2023-10-06T03:53:44.682075+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:53:44.682075+0000","last_undegraded":"2023-10-06T03:53:44.682075+0000","last_fullsized":"2023-10-06T03:53:44.682075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670029+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:53:44.670029+0000","last_peered":"2023-10-06T03:53:44.670029+0000","last_clean":"2023-10-06T03:53:44.670029+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:53:44.670029+0000","last_undegraded":"2023-10-06T03:53:44.670029+0000","last_fullsized":"2023-10-06T03:53:44.670029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682028+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:53:44.682028+0000","last_peered":"2023-10-06T03:53:44.682028+0000","last_clean":"2023-10-06T03:53:44.682028+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:53:44.682028+0000","last_undegraded":"2023-10-06T03:53:44.682028+0000","last_fullsized":"2023-10-06T03:53:44.682028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673250+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:53:44.673250+0000","last_peered":"2023-10-06T03:53:44.673250+0000","last_clean":"2023-10-06T03:53:44.673250+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:53:44.673250+0000","last_undegraded":"2023-10-06T03:53:44.673250+0000","last_fullsized":"2023-10-06T03:53:44.673250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681786+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:53:44.681786+0000","last_peered":"2023-10-06T03:53:44.681786+0000","last_clean":"2023-10-06T03:53:44.681786+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:53:44.681786+0000","last_undegraded":"2023-10-06T03:53:44.681786+0000","last_fullsized":"2023-10-06T03:53:44.681786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668742+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:53:44.668742+0000","last_peered":"2023-10-06T03:53:44.668742+0000","last_clean":"2023-10-06T03:53:44.668742+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:53:44.668742+0000","last_undegraded":"2023-10-06T03:53:44.668742+0000","last_fullsized":"2023-10-06T03:53:44.668742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.665811+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:53:44.665811+0000","last_peered":"2023-10-06T03:53:44.665811+0000","last_clean":"2023-10-06T03:53:44.665811+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:53:44.665811+0000","last_undegraded":"2023-10-06T03:53:44.665811+0000","last_fullsized":"2023-10-06T03:53:44.665811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652602+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:53:44.652602+0000","last_peered":"2023-10-06T03:53:44.652602+0000","last_clean":"2023-10-06T03:53:44.652602+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:53:44.652602+0000","last_undegraded":"2023-10-06T03:53:44.652602+0000","last_fullsized":"2023-10-06T03:53:44.652602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681806+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:53:44.681806+0000","last_peered":"2023-10-06T03:53:44.681806+0000","last_clean":"2023-10-06T03:53:44.681806+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:53:44.681806+0000","last_undegraded":"2023-10-06T03:53:44.681806+0000","last_fullsized":"2023-10-06T03:53:44.681806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652557+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:53:44.652557+0000","last_peered":"2023-10-06T03:53:44.652557+0000","last_clean":"2023-10-06T03:53:44.652557+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:53:44.652557+0000","last_undegraded":"2023-10-06T03:53:44.652557+0000","last_fullsized":"2023-10-06T03:53:44.652557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673546+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:53:44.673546+0000","last_peered":"2023-10-06T03:53:44.673546+0000","last_clean":"2023-10-06T03:53:44.673546+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:53:44.673546+0000","last_undegraded":"2023-10-06T03:53:44.673546+0000","last_fullsized":"2023-10-06T03:53:44.673546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673337+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:53:44.673337+0000","last_peered":"2023-10-06T03:53:44.673337+0000","last_clean":"2023-10-06T03:53:44.673337+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:53:44.673337+0000","last_undegraded":"2023-10-06T03:53:44.673337+0000","last_fullsized":"2023-10-06T03:53:44.673337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667802+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:53:44.667802+0000","last_peered":"2023-10-06T03:53:44.667802+0000","last_clean":"2023-10-06T03:53:44.667802+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:53:44.667802+0000","last_undegraded":"2023-10-06T03:53:44.667802+0000","last_fullsized":"2023-10-06T03:53:44.667802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662057+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:53:44.662057+0000","last_peered":"2023-10-06T03:53:44.662057+0000","last_clean":"2023-10-06T03:53:44.662057+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:53:44.662057+0000","last_undegraded":"2023-10-06T03:53:44.662057+0000","last_fullsized":"2023-10-06T03:53:44.662057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668273+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:53:44.668273+0000","last_peered":"2023-10-06T03:53:44.668273+0000","last_clean":"2023-10-06T03:53:44.668273+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:53:44.668273+0000","last_undegraded":"2023-10-06T03:53:44.668273+0000","last_fullsized":"2023-10-06T03:53:44.668273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670120+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:53:44.670120+0000","last_peered":"2023-10-06T03:53:44.670120+0000","last_clean":"2023-10-06T03:53:44.670120+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:53:44.670120+0000","last_undegraded":"2023-10-06T03:53:44.670120+0000","last_fullsized":"2023-10-06T03:53:44.670120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661720+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:53:44.661720+0000","last_peered":"2023-10-06T03:53:44.661720+0000","last_clean":"2023-10-06T03:53:44.661720+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:53:44.661720+0000","last_undegraded":"2023-10-06T03:53:44.661720+0000","last_fullsized":"2023-10-06T03:53:44.661720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673307+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:53:44.673307+0000","last_peered":"2023-10-06T03:53:44.673307+0000","last_clean":"2023-10-06T03:53:44.673307+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:53:44.673307+0000","last_undegraded":"2023-10-06T03:53:44.673307+0000","last_fullsized":"2023-10-06T03:53:44.673307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642704+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:53:44.642704+0000","last_peered":"2023-10-06T03:53:44.642704+0000","last_clean":"2023-10-06T03:53:44.642704+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:53:44.642704+0000","last_undegraded":"2023-10-06T03:53:44.642704+0000","last_fullsized":"2023-10-06T03:53:44.642704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681727+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:53:44.681727+0000","last_peered":"2023-10-06T03:53:44.681727+0000","last_clean":"2023-10-06T03:53:44.681727+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:53:44.681727+0000","last_undegraded":"2023-10-06T03:53:44.681727+0000","last_fullsized":"2023-10-06T03:53:44.681727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673004+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:53:44.673004+0000","last_peered":"2023-10-06T03:53:44.673004+0000","last_clean":"2023-10-06T03:53:44.673004+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:53:44.673004+0000","last_undegraded":"2023-10-06T03:53:44.673004+0000","last_fullsized":"2023-10-06T03:53:44.673004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668734+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:53:44.668734+0000","last_peered":"2023-10-06T03:53:44.668734+0000","last_clean":"2023-10-06T03:53:44.668734+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:53:44.668734+0000","last_undegraded":"2023-10-06T03:53:44.668734+0000","last_fullsized":"2023-10-06T03:53:44.668734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651174+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:53:44.651174+0000","last_peered":"2023-10-06T03:53:44.651174+0000","last_clean":"2023-10-06T03:53:44.651174+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:53:44.651174+0000","last_undegraded":"2023-10-06T03:53:44.651174+0000","last_fullsized":"2023-10-06T03:53:44.651174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669955+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:53:44.669955+0000","last_peered":"2023-10-06T03:53:44.669955+0000","last_clean":"2023-10-06T03:53:44.669955+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:53:44.669955+0000","last_undegraded":"2023-10-06T03:53:44.669955+0000","last_fullsized":"2023-10-06T03:53:44.669955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.638833+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:53:44.638833+0000","last_peered":"2023-10-06T03:53:44.638833+0000","last_clean":"2023-10-06T03:53:44.638833+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:53:44.638833+0000","last_undegraded":"2023-10-06T03:53:44.638833+0000","last_fullsized":"2023-10-06T03:53:44.638833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669986+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:53:44.669986+0000","last_peered":"2023-10-06T03:53:44.669986+0000","last_clean":"2023-10-06T03:53:44.669986+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:53:44.669986+0000","last_undegraded":"2023-10-06T03:53:44.669986+0000","last_fullsized":"2023-10-06T03:53:44.669986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642295+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:53:44.642295+0000","last_peered":"2023-10-06T03:53:44.642295+0000","last_clean":"2023-10-06T03:53:44.642295+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:53:44.642295+0000","last_undegraded":"2023-10-06T03:53:44.642295+0000","last_fullsized":"2023-10-06T03:53:44.642295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682133+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:53:44.682133+0000","last_peered":"2023-10-06T03:53:44.682133+0000","last_clean":"2023-10-06T03:53:44.682133+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:53:44.682133+0000","last_undegraded":"2023-10-06T03:53:44.682133+0000","last_fullsized":"2023-10-06T03:53:44.682133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":166,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652684+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:53:44.652684+0000","last_peered":"2023-10-06T03:53:44.652684+0000","last_clean":"2023-10-06T03:53:44.652684+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:53:44.652684+0000","last_undegraded":"2023-10-06T03:53:44.652684+0000","last_fullsized":"2023-10-06T03:53:44.652684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641956+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:53:44.641956+0000","last_peered":"2023-10-06T03:53:44.641956+0000","last_clean":"2023-10-06T03:53:44.641956+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:53:44.641956+0000","last_undegraded":"2023-10-06T03:53:44.641956+0000","last_fullsized":"2023-10-06T03:53:44.641956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.643279+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:53:44.643279+0000","last_peered":"2023-10-06T03:53:44.643279+0000","last_clean":"2023-10-06T03:53:44.643279+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:53:44.643279+0000","last_undegraded":"2023-10-06T03:53:44.643279+0000","last_fullsized":"2023-10-06T03:53:44.643279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672060+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:53:44.672060+0000","last_peered":"2023-10-06T03:53:44.672060+0000","last_clean":"2023-10-06T03:53:44.672060+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:53:44.672060+0000","last_undegraded":"2023-10-06T03:53:44.672060+0000","last_fullsized":"2023-10-06T03:53:44.672060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651771+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:53:44.651771+0000","last_peered":"2023-10-06T03:53:44.651771+0000","last_clean":"2023-10-06T03:53:44.651771+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:53:44.651771+0000","last_undegraded":"2023-10-06T03:53:44.651771+0000","last_fullsized":"2023-10-06T03:53:44.651771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652194+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:53:44.652194+0000","last_peered":"2023-10-06T03:53:44.652194+0000","last_clean":"2023-10-06T03:53:44.652194+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:53:44.652194+0000","last_undegraded":"2023-10-06T03:53:44.652194+0000","last_fullsized":"2023-10-06T03:53:44.652194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673823+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:53:44.673823+0000","last_peered":"2023-10-06T03:53:44.673823+0000","last_clean":"2023-10-06T03:53:44.673823+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:53:44.673823+0000","last_undegraded":"2023-10-06T03:53:44.673823+0000","last_fullsized":"2023-10-06T03:53:44.673823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.652382+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:53:44.652382+0000","last_peered":"2023-10-06T03:53:44.652382+0000","last_clean":"2023-10-06T03:53:44.652382+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:53:44.652382+0000","last_undegraded":"2023-10-06T03:53:44.652382+0000","last_fullsized":"2023-10-06T03:53:44.652382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644523+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:53:44.644523+0000","last_peered":"2023-10-06T03:53:44.644523+0000","last_clean":"2023-10-06T03:53:44.644523+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:53:44.644523+0000","last_undegraded":"2023-10-06T03:53:44.644523+0000","last_fullsized":"2023-10-06T03:53:44.644523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670663+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:53:44.670663+0000","last_peered":"2023-10-06T03:53:44.670663+0000","last_clean":"2023-10-06T03:53:44.670663+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:53:44.670663+0000","last_undegraded":"2023-10-06T03:53:44.670663+0000","last_fullsized":"2023-10-06T03:53:44.670663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644267+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:53:44.644267+0000","last_peered":"2023-10-06T03:53:44.644267+0000","last_clean":"2023-10-06T03:53:44.644267+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:53:44.644267+0000","last_undegraded":"2023-10-06T03:53:44.644267+0000","last_fullsized":"2023-10-06T03:53:44.644267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.641446+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:53:44.641446+0000","last_peered":"2023-10-06T03:53:44.641446+0000","last_clean":"2023-10-06T03:53:44.641446+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:53:44.641446+0000","last_undegraded":"2023-10-06T03:53:44.641446+0000","last_fullsized":"2023-10-06T03:53:44.641446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682392+0000","last_change":"2023-10-06T03:53:44.672856+0000","last_active":"2023-10-06T03:53:44.682392+0000","last_peered":"2023-10-06T03:53:44.682392+0000","last_clean":"2023-10-06T03:53:44.682392+0000","last_became_active":"2023-10-06T03:53:44.670507+0000","last_became_peered":"2023-10-06T03:53:44.670507+0000","last_unstale":"2023-10-06T03:53:44.682392+0000","last_undegraded":"2023-10-06T03:53:44.682392+0000","last_fullsized":"2023-10-06T03:53:44.682392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644465+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:53:44.644465+0000","last_peered":"2023-10-06T03:53:44.644465+0000","last_clean":"2023-10-06T03:53:44.644465+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:53:44.644465+0000","last_undegraded":"2023-10-06T03:53:44.644465+0000","last_fullsized":"2023-10-06T03:53:44.644465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.649711+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:53:44.649711+0000","last_peered":"2023-10-06T03:53:44.649711+0000","last_clean":"2023-10-06T03:53:44.649711+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:53:44.649711+0000","last_undegraded":"2023-10-06T03:53:44.649711+0000","last_fullsized":"2023-10-06T03:53:44.649711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670177+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:53:44.670177+0000","last_peered":"2023-10-06T03:53:44.670177+0000","last_clean":"2023-10-06T03:53:44.670177+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:53:44.670177+0000","last_undegraded":"2023-10-06T03:53:44.670177+0000","last_fullsized":"2023-10-06T03:53:44.670177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.649894+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:53:44.649894+0000","last_peered":"2023-10-06T03:53:44.649894+0000","last_clean":"2023-10-06T03:53:44.649894+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:53:44.649894+0000","last_undegraded":"2023-10-06T03:53:44.649894+0000","last_fullsized":"2023-10-06T03:53:44.649894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655203+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:53:44.655203+0000","last_peered":"2023-10-06T03:53:44.655203+0000","last_clean":"2023-10-06T03:53:44.655203+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:53:44.655203+0000","last_undegraded":"2023-10-06T03:53:44.655203+0000","last_fullsized":"2023-10-06T03:53:44.655203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681705+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:53:44.681705+0000","last_peered":"2023-10-06T03:53:44.681705+0000","last_clean":"2023-10-06T03:53:44.681705+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:53:44.681705+0000","last_undegraded":"2023-10-06T03:53:44.681705+0000","last_fullsized":"2023-10-06T03:53:44.681705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.662120+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:53:44.662120+0000","last_peered":"2023-10-06T03:53:44.662120+0000","last_clean":"2023-10-06T03:53:44.662120+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:53:44.662120+0000","last_undegraded":"2023-10-06T03:53:44.662120+0000","last_fullsized":"2023-10-06T03:53:44.662120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644308+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:53:44.644308+0000","last_peered":"2023-10-06T03:53:44.644308+0000","last_clean":"2023-10-06T03:53:44.644308+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:53:44.644308+0000","last_undegraded":"2023-10-06T03:53:44.644308+0000","last_fullsized":"2023-10-06T03:53:44.644308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670632+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:53:44.670632+0000","last_peered":"2023-10-06T03:53:44.670632+0000","last_clean":"2023-10-06T03:53:44.670632+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:53:44.670632+0000","last_undegraded":"2023-10-06T03:53:44.670632+0000","last_fullsized":"2023-10-06T03:53:44.670632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-06T03:53:46.838440+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:53:46.838440+0000","last_peered":"2023-10-06T03:53:46.838440+0000","last_clean":"2023-10-06T03:53:46.838440+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:53:46.838440+0000","last_undegraded":"2023-10-06T03:53:46.838440+0000","last_fullsized":"2023-10-06T03:53:46.838440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.651572+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:53:44.651572+0000","last_peered":"2023-10-06T03:53:44.651572+0000","last_clean":"2023-10-06T03:53:44.651572+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:53:44.651572+0000","last_undegraded":"2023-10-06T03:53:44.651572+0000","last_fullsized":"2023-10-06T03:53:44.651572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654585+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:53:44.654585+0000","last_peered":"2023-10-06T03:53:44.654585+0000","last_clean":"2023-10-06T03:53:44.654585+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:53:44.654585+0000","last_undegraded":"2023-10-06T03:53:44.654585+0000","last_fullsized":"2023-10-06T03:53:44.654585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.668210+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:53:44.668210+0000","last_peered":"2023-10-06T03:53:44.668210+0000","last_clean":"2023-10-06T03:53:44.668210+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:53:44.668210+0000","last_undegraded":"2023-10-06T03:53:44.668210+0000","last_fullsized":"2023-10-06T03:53:44.668210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672268+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:53:44.672268+0000","last_peered":"2023-10-06T03:53:44.672268+0000","last_clean":"2023-10-06T03:53:44.672268+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:53:44.672268+0000","last_undegraded":"2023-10-06T03:53:44.672268+0000","last_fullsized":"2023-10-06T03:53:44.672268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.682362+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:53:44.682362+0000","last_peered":"2023-10-06T03:53:44.682362+0000","last_clean":"2023-10-06T03:53:44.682362+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:53:44.682362+0000","last_undegraded":"2023-10-06T03:53:44.682362+0000","last_fullsized":"2023-10-06T03:53:44.682362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672974+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:53:44.672974+0000","last_peered":"2023-10-06T03:53:44.672974+0000","last_clean":"2023-10-06T03:53:44.672974+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:53:44.672974+0000","last_undegraded":"2023-10-06T03:53:44.672974+0000","last_fullsized":"2023-10-06T03:53:44.672974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.644490+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:53:44.644490+0000","last_peered":"2023-10-06T03:53:44.644490+0000","last_clean":"2023-10-06T03:53:44.644490+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:53:44.644490+0000","last_undegraded":"2023-10-06T03:53:44.644490+0000","last_fullsized":"2023-10-06T03:53:44.644490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681914+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:53:44.681914+0000","last_peered":"2023-10-06T03:53:44.681914+0000","last_clean":"2023-10-06T03:53:44.681914+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:53:44.681914+0000","last_undegraded":"2023-10-06T03:53:44.681914+0000","last_fullsized":"2023-10-06T03:53:44.681914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.654947+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:53:44.654947+0000","last_peered":"2023-10-06T03:53:44.654947+0000","last_clean":"2023-10-06T03:53:44.654947+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:53:44.654947+0000","last_undegraded":"2023-10-06T03:53:44.654947+0000","last_fullsized":"2023-10-06T03:53:44.654947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673706+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:53:44.673706+0000","last_peered":"2023-10-06T03:53:44.673706+0000","last_clean":"2023-10-06T03:53:44.673706+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:53:44.673706+0000","last_undegraded":"2023-10-06T03:53:44.673706+0000","last_fullsized":"2023-10-06T03:53:44.673706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672261+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:53:44.672261+0000","last_peered":"2023-10-06T03:53:44.672261+0000","last_clean":"2023-10-06T03:53:44.672261+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:53:44.672261+0000","last_undegraded":"2023-10-06T03:53:44.672261+0000","last_fullsized":"2023-10-06T03:53:44.672261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.642090+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:53:44.642090+0000","last_peered":"2023-10-06T03:53:44.642090+0000","last_clean":"2023-10-06T03:53:44.642090+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:53:44.642090+0000","last_undegraded":"2023-10-06T03:53:44.642090+0000","last_fullsized":"2023-10-06T03:53:44.642090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.681679+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:53:44.681679+0000","last_peered":"2023-10-06T03:53:44.681679+0000","last_clean":"2023-10-06T03:53:44.681679+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:53:44.681679+0000","last_undegraded":"2023-10-06T03:53:44.681679+0000","last_fullsized":"2023-10-06T03:53:44.681679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.648972+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:53:44.648972+0000","last_peered":"2023-10-06T03:53:44.648972+0000","last_clean":"2023-10-06T03:53:44.648972+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:53:44.648972+0000","last_undegraded":"2023-10-06T03:53:44.648972+0000","last_fullsized":"2023-10-06T03:53:44.648972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673553+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:53:44.673553+0000","last_peered":"2023-10-06T03:53:44.673553+0000","last_clean":"2023-10-06T03:53:44.673553+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:53:44.673553+0000","last_undegraded":"2023-10-06T03:53:44.673553+0000","last_fullsized":"2023-10-06T03:53:44.673553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.660417+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:53:44.660417+0000","last_peered":"2023-10-06T03:53:44.660417+0000","last_clean":"2023-10-06T03:53:44.660417+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:53:44.660417+0000","last_undegraded":"2023-10-06T03:53:44.660417+0000","last_fullsized":"2023-10-06T03:53:44.660417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.672673+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:53:44.672673+0000","last_peered":"2023-10-06T03:53:44.672673+0000","last_clean":"2023-10-06T03:53:44.672673+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:53:44.672673+0000","last_undegraded":"2023-10-06T03:53:44.672673+0000","last_fullsized":"2023-10-06T03:53:44.672673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.659382+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:53:44.659382+0000","last_peered":"2023-10-06T03:53:44.659382+0000","last_clean":"2023-10-06T03:53:44.659382+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:53:44.659382+0000","last_undegraded":"2023-10-06T03:53:44.659382+0000","last_fullsized":"2023-10-06T03:53:44.659382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667758+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:53:44.667758+0000","last_peered":"2023-10-06T03:53:44.667758+0000","last_clean":"2023-10-06T03:53:44.667758+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:53:44.667758+0000","last_undegraded":"2023-10-06T03:53:44.667758+0000","last_fullsized":"2023-10-06T03:53:44.667758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.657092+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:53:44.657092+0000","last_peered":"2023-10-06T03:53:44.657092+0000","last_clean":"2023-10-06T03:53:44.657092+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:53:44.657092+0000","last_undegraded":"2023-10-06T03:53:44.657092+0000","last_fullsized":"2023-10-06T03:53:44.657092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.667741+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:53:44.667741+0000","last_peered":"2023-10-06T03:53:44.667741+0000","last_clean":"2023-10-06T03:53:44.667741+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:53:44.667741+0000","last_undegraded":"2023-10-06T03:53:44.667741+0000","last_fullsized":"2023-10-06T03:53:44.667741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.655893+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:53:44.655893+0000","last_peered":"2023-10-06T03:53:44.655893+0000","last_clean":"2023-10-06T03:53:44.655893+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:53:44.655893+0000","last_undegraded":"2023-10-06T03:53:44.655893+0000","last_fullsized":"2023-10-06T03:53:44.655893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.661741+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:53:44.661741+0000","last_peered":"2023-10-06T03:53:44.661741+0000","last_clean":"2023-10-06T03:53:44.661741+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:53:44.661741+0000","last_undegraded":"2023-10-06T03:53:44.661741+0000","last_fullsized":"2023-10-06T03:53:44.661741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.670951+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:53:44.670951+0000","last_peered":"2023-10-06T03:53:44.670951+0000","last_clean":"2023-10-06T03:53:44.670951+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:53:44.670951+0000","last_undegraded":"2023-10-06T03:53:44.670951+0000","last_fullsized":"2023-10-06T03:53:44.670951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.669987+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:53:44.669987+0000","last_peered":"2023-10-06T03:53:44.669987+0000","last_clean":"2023-10-06T03:53:44.669987+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:53:44.669987+0000","last_undegraded":"2023-10-06T03:53:44.669987+0000","last_fullsized":"2023-10-06T03:53:44.669987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T03:53:44.673850+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:53:44.673850+0000","last_peered":"2023-10-06T03:53:44.673850+0000","last_clean":"2023-10-06T03:53:44.673850+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:53:44.673850+0000","last_undegraded":"2023-10-06T03:53:44.673850+0000","last_fullsized":"2023-10-06T03:53:44.673850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":689381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297552,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074288,"statfs":{"total":96636764160,"available":96332070912,"internally_reserved":0,"allocated":270336,"data_stored":97885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":282624,"data_stored":98853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301644,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070196,"statfs":{"total":96636764160,"available":96327880704,"internally_reserved":0,"allocated":266240,"data_stored":97351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301640,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070200,"statfs":{"total":96636764160,"available":96327884800,"internally_reserved":0,"allocated":262144,"data_stored":97261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302224,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069616,"statfs":{"total":96636764160,"available":96327286784,"internally_reserved":0,"allocated":860160,"data_stored":688183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:53:52.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:53:52.580 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:53:52.580 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:53:52.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:53:52.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.671+0000 7f94d100a700 1 Processor -- start 2023-10-06T03:53:52.677 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- start start 2023-10-06T03:53:52.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc0701c0 0x7f94cc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f94cc06c310 0x7f94cc1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc0b0910 con 0x7f94cc145ce0 2023-10-06T03:53:52.679 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc146180 con 0x7f94cc06c310 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0b02c0 con 0x7f94cc0701c0 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f94cc06c310 0x7f94cc1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f94cc06c310 0x7f94cc1457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45986/0 (socket says 172.21.15.57:45986) 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 -- 172.21.15.57:0/2877432428 learned_addr learned my addr 172.21.15.57:0/2877432428 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cbfff700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc0701c0 0x7f94cc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 -- 172.21.15.57:0/2877432428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc0701c0 msgr2=0x7f94cc0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:52.680 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc0701c0 0x7f94cc0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 -- 172.21.15.57:0/2877432428 >> v1:172.21.15.105:6789/0 conn(0x7f94cc145ce0 legacy=0x7f94cc13bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 -- 172.21.15.57:0/2877432428 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0b05a0 con 0x7f94cc06c310 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94cb7fe700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1457a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f94b40099e0 tx=0x7f94b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d052babe8d9ffea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94caffd700 1 -- 172.21.15.57:0/2877432428 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b400b820 con 0x7f94cc06c310 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94caffd700 1 -- 172.21.15.57:0/2877432428 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b400b980 con 0x7f94cc06c310 2023-10-06T03:53:52.681 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94caffd700 1 -- 172.21.15.57:0/2877432428 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b400bd40 con 0x7f94cc06c310 2023-10-06T03:53:52.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- 172.21.15.57:0/2877432428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 msgr2=0x7f94cc1457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1457a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f94b40099e0 tx=0x7f94b4009250 comp rx=0 tx=0).stop 2023-10-06T03:53:52.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- 172.21.15.57:0/2877432428 shutdown_connections 2023-10-06T03:53:52.682 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1457a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 --2- 172.21.15.57:0/2877432428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc0701c0 0x7f94cc0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- 172.21.15.57:0/2877432428 >> 172.21.15.57:0/2877432428 conn(0x7f94cc0b1a00 msgr2=0x7f94cc0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- 172.21.15.57:0/2877432428 shutdown_connections 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.675+0000 7f94d100a700 1 -- 172.21.15.57:0/2877432428 wait complete. 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 Processor -- start 2023-10-06T03:53:52.683 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- start start 2023-10-06T03:53:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94cc0701c0 0x7f94cc0aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc145ce0 0x7f94cc155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0a9e50 con 0x7f94cc06c310 2023-10-06T03:53:52.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0a8d30 con 0x7f94cc0701c0 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0ae0e0 con 0x7f94cc145ce0 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45992/0 (socket says 172.21.15.57:45992) 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 -- 172.21.15.57:0/3931946912 learned_addr learned my addr 172.21.15.57:0/3931946912 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cb7fe700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94cc0701c0 0x7f94cc0aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d0809700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc145ce0 0x7f94cc155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 -- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc145ce0 msgr2=0x7f94cc155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc145ce0 0x7f94cc155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 -- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94cc0701c0 msgr2=0x7f94cc0aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94cc0701c0 0x7f94cc0aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.686 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 -- 172.21.15.57:0/3931946912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40094f0 con 0x7f94cc06c310 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94cbfff700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00d890 tx=0x7f94bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0125f0 con 0x7f94cc06c310 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc012750 con 0x7f94cc06c310 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc0af310 con 0x7f94cc06c310 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc012af0 con 0x7f94cc06c310 2023-10-06T03:53:52.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.679+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc0ae610 con 0x7f94cc06c310 2023-10-06T03:53:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc06b930 con 0x7f94cc06c310 2023-10-06T03:53:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f94bc01e460 con 0x7f94cc06c310 2023-10-06T03:53:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94c3fff700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 0x7f94ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f94bc07cec0 con 0x7f94cc06c310 2023-10-06T03:53:52.688 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94cb7fe700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 0x7f94ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:52.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.683+0000 7f94cb7fe700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 0x7f94ac062a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94b40099e0 tx=0x7f94b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:52.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.691+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f94bc04d350 con 0x7f94cc06c310 2023-10-06T03:53:52.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.883+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f94cc0aff10 con 0x7f94cc06c310 2023-10-06T03:53:52.888 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.883+0000 7f94c3fff700 1 -- 172.21.15.57:0/3931946912 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f94bc050970 con 0x7f94cc06c310 2023-10-06T03:53:52.888 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:52.888 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:53:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 msgr2=0x7f94ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 0x7f94ac062a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94b40099e0 tx=0x7f94b4017000 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 msgr2=0x7f94cc1427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00d890 tx=0x7f94bc008040 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 shutdown_connections 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f94ac060550 0x7f94ac062a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94cc145ce0 0x7f94cc155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94cc0701c0 0x7f94cc0aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 --2- 172.21.15.57:0/3931946912 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94cc06c310 0x7f94cc1427c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 >> 172.21.15.57:0/3931946912 conn(0x7f94cc0b1a00 msgr2=0x7f94cc0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 shutdown_connections 2023-10-06T03:53:52.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.887+0000 7f94d100a700 1 -- 172.21.15.57:0/3931946912 wait complete. 2023-10-06T03:53:52.901 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:53:52.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:53.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 Processor -- start 2023-10-06T03:53:53.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 -- start start 2023-10-06T03:53:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bd40b32a0 0x7f6bd40b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 0x7f6bd4068f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6bd4069490 0x7f6bd406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd413c990 con 0x7f6bd40b32a0 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd4142280 con 0x7f6bd4069490 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.995+0000 7f6bda7f2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd4142520 con 0x7f6bd4142a20 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bd40b32a0 0x7f6bd40b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bd40b32a0 0x7f6bd40b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45996/0 (socket says 172.21.15.57:45996) 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 -- 172.21.15.57:0/3897888468 learned_addr learned my addr 172.21.15.57:0/3897888468 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd9ff1700 1 --2- 172.21.15.57:0/3897888468 >> v2:172.21.15.105:3300/0 conn(0x7f6bd4069490 0x7f6bd406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd8fef700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 0x7f6bd4068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 -- 172.21.15.57:0/3897888468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 msgr2=0x7f6bd4068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 0x7f6bd4068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 -- 172.21.15.57:0/3897888468 >> v2:172.21.15.105:3300/0 conn(0x7f6bd4069490 msgr2=0x7f6bd406dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3897888468 >> v2:172.21.15.105:3300/0 conn(0x7f6bd4069490 0x7f6bd406dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 -- 172.21.15.57:0/3897888468 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4069920 con 0x7f6bd40b32a0 2023-10-06T03:53:53.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd8fef700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 0x7f6bd4068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b3670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bd406a330 tx=0x7f6bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4237e7ebc3568f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bc7fff700 1 -- 172.21.15.57:0/3897888468 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0009e70 con 0x7f6bd40b32a0 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bc7fff700 1 -- 172.21.15.57:0/3897888468 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000b860 con 0x7f6bd40b32a0 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bc7fff700 1 -- 172.21.15.57:0/3897888468 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000bc00 con 0x7f6bd40b32a0 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3897888468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd40b32a0 msgr2=0x7f6bd40b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b3670 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6bd406a330 tx=0x7f6bd0009250 comp rx=0 tx=0).stop 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3897888468 shutdown_connections 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3897888468 >> v2:172.21.15.105:3300/0 conn(0x7f6bd4069490 0x7f6bd406dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4142a20 0x7f6bd4068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3897888468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b3670 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3897888468 >> 172.21.15.57:0/3897888468 conn(0x7f6bd4067070 msgr2=0x7f6bd4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3897888468 shutdown_connections 2023-10-06T03:53:53.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3897888468 wait complete. 2023-10-06T03:53:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 Processor -- start 2023-10-06T03:53:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:52.999+0000 7f6bda7f2700 1 -- start start 2023-10-06T03:53:53.010 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4069490 0x7f6bd4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40b0d60 con 0x7f6bd4142a20 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40aef60 con 0x7f6bd40b32a0 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40b6140 con 0x7f6bd4069490 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46006/0 (socket says 172.21.15.57:46006) 2023-10-06T03:53:53.011 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 -- 172.21.15.57:0/3963404433 learned_addr learned my addr 172.21.15.57:0/3963404433 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4069490 0x7f6bd4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd8fef700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 -- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4069490 msgr2=0x7f6bd4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4069490 0x7f6bd4152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 -- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bd40b32a0 msgr2=0x7f6bd40b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 -- 172.21.15.57:0/3963404433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd00094f0 con 0x7f6bd4142a20 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bd9ff1700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009ef0 tx=0x7f6bcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00cc50 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00f040 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd40b66b0 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc014480 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd4153090 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.003+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40b68f0 con 0x7f6bd4142a20 2023-10-06T03:53:53.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.007+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6bcc014830 con 0x7f6bd4142a20 2023-10-06T03:53:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.007+0000 7f6bc57fa700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 0x7f6bb8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.007+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bcc07dac0 con 0x7f6bd4142a20 2023-10-06T03:53:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.007+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 0x7f6bb8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.007+0000 7f6bd97f0700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 0x7f6bb8062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6bd406a330 tx=0x7f6bd0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.011+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6bcc04df30 con 0x7f6bd4142a20 2023-10-06T03:53:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.171+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bd40b6370 con 0x7f6bd4142a20 2023-10-06T03:53:53.176 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.171+0000 7f6bc57fa700 1 -- 172.21.15.57:0/3963404433 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f6bcc051550 con 0x7f6bd4142a20 2023-10-06T03:53:53.177 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 msgr2=0x7f6bb8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 0x7f6bb8062a00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6bd406a330 tx=0x7f6bd0017000 comp rx=0 tx=0).stop 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 msgr2=0x7f6bd40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009ef0 tx=0x7f6bcc00b040 comp rx=0 tx=0).stop 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 shutdown_connections 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6bb8060550 0x7f6bb8062a00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.179 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bd4142a20 0x7f6bd40b7110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bd40b32a0 0x7f6bd40b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 --2- 172.21.15.57:0/3963404433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bd4069490 0x7f6bd4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 >> 172.21.15.57:0/3963404433 conn(0x7f6bd4067070 msgr2=0x7f6bd40b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 shutdown_connections 2023-10-06T03:53:53.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.175+0000 7f6bda7f2700 1 -- 172.21.15.57:0/3963404433 wait complete. 2023-10-06T03:53:53.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:53:32.687516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:53:38.405877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:53:42.316403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:53:42.989663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:53:53.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:53:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 Processor -- start 2023-10-06T03:53:53.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 -- start start 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d240b2b80 0x7f3d240b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240b10a0 con 0x7f3d24067210 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240b4aa0 con 0x7f3d240b4f30 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240b1b10 con 0x7f3d240b2b80 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d24067210 0x7f3d241457f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34660/0 (socket says 172.21.15.57:34660) 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2259c700 1 -- 172.21.15.57:0/3231137041 learned_addr learned my addr 172.21.15.57:0/3231137041 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:53.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d21d9b700 1 --2- 172.21.15.57:0/3231137041 >> v2:172.21.15.105:3300/0 conn(0x7f3d240b2b80 0x7f3d240b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2159a700 1 -- 172.21.15.57:0/3231137041 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024144179 0 0) 0x7f3d240b10a0 con 0x7f3d24067210 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2159a700 1 -- 172.21.15.57:0/3231137041 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d10003570 con 0x7f3d24067210 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d21d9b700 1 -- 172.21.15.57:0/3231137041 >> v1:172.21.15.105:6789/0 conn(0x7f3d240b4f30 legacy=0x7f3d24145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d21d9b700 1 -- 172.21.15.57:0/3231137041 >> v1:172.21.15.57:6789/0 conn(0x7f3d24067210 legacy=0x7f3d241457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d21d9b700 1 -- 172.21.15.57:0/3231137041 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240b0190 con 0x7f3d240b2b80 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d21d9b700 1 --2- 172.21.15.57:0/3231137041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d240b2b80 0x7f3d240b07a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009e60 tx=0x7f3d14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a335c30fb0667c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2159a700 1 -- 172.21.15.57:0/3231137041 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400e070 con 0x7f3d240b2b80 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2159a700 1 -- 172.21.15.57:0/3231137041 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1400bb60 con 0x7f3d240b2b80 2023-10-06T03:53:53.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.295+0000 7f3d2159a700 1 -- 172.21.15.57:0/3231137041 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14012430 con 0x7f3d240b2b80 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- 172.21.15.57:0/3231137041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d240b2b80 msgr2=0x7f3d240b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 --2- 172.21.15.57:0/3231137041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d240b2b80 0x7f3d240b07a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009e60 tx=0x7f3d14009780 comp rx=0 tx=0).stop 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- 172.21.15.57:0/3231137041 shutdown_connections 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 --2- 172.21.15.57:0/3231137041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d240b2b80 0x7f3d240b07a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- 172.21.15.57:0/3231137041 >> 172.21.15.57:0/3231137041 conn(0x7f3d240b8bb0 msgr2=0x7f3d240b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- 172.21.15.57:0/3231137041 shutdown_connections 2023-10-06T03:53:53.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- 172.21.15.57:0/3231137041 wait complete. 2023-10-06T03:53:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 Processor -- start 2023-10-06T03:53:53.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.299+0000 7f3d2359e700 1 -- start start 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d24067210 0x7f3d24155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b4f30 0x7f3d2413edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d241524b0 con 0x7f3d240b2b80 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24152d10 con 0x7f3d24067210 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240af360 con 0x7f3d240b4f30 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46022/0 (socket says 172.21.15.57:46022) 2023-10-06T03:53:53.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 -- 172.21.15.57:0/880254935 learned_addr learned my addr 172.21.15.57:0/880254935 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2259c700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d24067210 0x7f3d24155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d22d9d700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b4f30 0x7f3d2413edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 -- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b4f30 msgr2=0x7f3d2413edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b4f30 0x7f3d2413edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 -- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d24067210 msgr2=0x7f3d24155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d24067210 0x7f3d24155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 -- 172.21.15.57:0/880254935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009a20 con 0x7f3d240b2b80 2023-10-06T03:53:53.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d21d9b700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400b6c0 tx=0x7f3d14019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14007000 con 0x7f3d240b2b80 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14021070 con 0x7f3d240b2b80 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d241526c0 con 0x7f3d240b2b80 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14012b40 con 0x7f3d240b2b80 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.303+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d24152a50 con 0x7f3d240b2b80 2023-10-06T03:53:53.309 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3d14023030 con 0x7f3d240b2b80 2023-10-06T03:53:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d240b13e0 con 0x7f3d240b2b80 2023-10-06T03:53:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d1a7fc700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 0x7f3d04062a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d1407e6a0 con 0x7f3d240b2b80 2023-10-06T03:53:53.310 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d2259c700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 0x7f3d04062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.311 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.307+0000 7f3d2259c700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 0x7f3d04062a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.317 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.315+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d240b13e0 con 0x7f3d240b2b80 2023-10-06T03:53:53.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.467+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d240b13e0 con 0x7f3d240b2b80 2023-10-06T03:53:53.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.467+0000 7f3d1a7fc700 1 -- 172.21.15.57:0/880254935 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d240b13e0 con 0x7f3d240b2b80 2023-10-06T03:53:53.473 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:53:53.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 msgr2=0x7f3d04062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 0x7f3d04062a80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007fd0 tx=0x7f3d0c009040 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 msgr2=0x7f3d240ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400b6c0 tx=0x7f3d14019000 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 shutdown_connections 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d040605d0 0x7f3d04062a80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b4f30 0x7f3d2413edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d240b2b80 0x7f3d240ae580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 --2- 172.21.15.57:0/880254935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d24067210 0x7f3d24155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 >> 172.21.15.57:0/880254935 conn(0x7f3d240b8bb0 msgr2=0x7f3d240b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 shutdown_connections 2023-10-06T03:53:53.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.471+0000 7f3d2359e700 1 -- 172.21.15.57:0/880254935 wait complete. 2023-10-06T03:53:53.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:53:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 Processor -- start 2023-10-06T03:53:53.595 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 -- start start 2023-10-06T03:53:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc86006d670 0x7fc8600b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86006ddb0 con 0x7fc86006f300 2023-10-06T03:53:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86013fea0 con 0x7fc86006cc60 2023-10-06T03:53:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc8652af700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc860143300 con 0x7fc86006d670 2023-10-06T03:53:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc864aae700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc86006f300 0x7fc860142bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34670/0 (socket says 172.21.15.57:34670) 2023-10-06T03:53:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc864aae700 1 -- 172.21.15.57:0/1552337776 learned_addr learned my addr 172.21.15.57:0/1552337776 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:53.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.591+0000 7fc85ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc86006d670 0x7fc8600b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85effd700 1 -- 172.21.15.57:0/1552337776 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998785952 0 0) 0x7fc86006ddb0 con 0x7fc86006f300 2023-10-06T03:53:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85effd700 1 -- 172.21.15.57:0/1552337776 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc848003570 con 0x7fc86006f300 2023-10-06T03:53:53.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85ffff700 1 -- 172.21.15.57:0/1552337776 >> v1:172.21.15.105:6789/0 conn(0x7fc86006cc60 legacy=0x7fc8601424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85ffff700 1 -- 172.21.15.57:0/1552337776 >> v1:172.21.15.57:6789/0 conn(0x7fc86006f300 legacy=0x7fc860142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85ffff700 1 -- 172.21.15.57:0/1552337776 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86013f850 con 0x7fc86006d670 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85ffff700 1 --2- 172.21.15.57:0/1552337776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600b04f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8500098e0 tx=0x7fc8500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d22aee7cb9cffe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85effd700 1 -- 172.21.15.57:0/1552337776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000b640 con 0x7fc86006d670 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85effd700 1 -- 172.21.15.57:0/1552337776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000b7a0 con 0x7fc86006d670 2023-10-06T03:53:53.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc85effd700 1 -- 172.21.15.57:0/1552337776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000bb20 con 0x7fc86006d670 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 -- 172.21.15.57:0/1552337776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 msgr2=0x7fc8600b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 --2- 172.21.15.57:0/1552337776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600b04f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc8500098e0 tx=0x7fc8500091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 -- 172.21.15.57:0/1552337776 shutdown_connections 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 --2- 172.21.15.57:0/1552337776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600b04f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 -- 172.21.15.57:0/1552337776 >> 172.21.15.57:0/1552337776 conn(0x7fc860068180 msgr2=0x7fc860068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 -- 172.21.15.57:0/1552337776 shutdown_connections 2023-10-06T03:53:53.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 -- 172.21.15.57:0/1552337776 wait complete. 2023-10-06T03:53:53.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.595+0000 7fc8652af700 1 Processor -- start 2023-10-06T03:53:53.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- start start 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86006cc60 0x7fc860152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 0x7fc8600b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601522d0 con 0x7fc86006d670 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600afb50 con 0x7fc86006cc60 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8600b5690 con 0x7fc86006f300 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46042/0 (socket says 172.21.15.57:46042) 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 -- 172.21.15.57:0/1217906988 learned_addr learned my addr 172.21.15.57:0/1217906988 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85ffff700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86006cc60 0x7fc860152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc864aae700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 0x7fc8600b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 -- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 msgr2=0x7fc8600b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 0x7fc8600b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 -- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86006cc60 msgr2=0x7fc860152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86006cc60 0x7fc860152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 -- 172.21.15.57:0/1217906988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850009420 con 0x7fc86006d670 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc864aae700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 0x7fc8600b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc85f7fe700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c590 tx=0x7fc854007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011590 con 0x7fc86006d670 2023-10-06T03:53:53.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854011730 con 0x7fc86006d670 2023-10-06T03:53:53.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860152540 con 0x7fc86006d670 2023-10-06T03:53:53.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854011af0 con 0x7fc86006d670 2023-10-06T03:53:53.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8600b6340 con 0x7fc86006d670 2023-10-06T03:53:53.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.599+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8600b6560 con 0x7fc86006d670 2023-10-06T03:53:53.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.603+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc854012420 con 0x7fc86006d670 2023-10-06T03:53:53.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.603+0000 7fc847fff700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 0x7fc84c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.603+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc85407c450 con 0x7fc86006d670 2023-10-06T03:53:53.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.603+0000 7fc85ffff700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 0x7fc84c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.607+0000 7fc85ffff700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 0x7fc84c062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8500091e0 tx=0x7fc850017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.611+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc85404ca10 con 0x7fc86006d670 2023-10-06T03:53:53.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.767+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc86013fb30 con 0x7fc86006d670 2023-10-06T03:53:53.773 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc847fff700 1 -- 172.21.15.57:0/1217906988 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8540210a0 con 0x7fc86006d670 2023-10-06T03:53:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 msgr2=0x7fc84c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 0x7fc84c062a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8500091e0 tx=0x7fc850017000 comp rx=0 tx=0).stop 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 msgr2=0x7fc8600af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c590 tx=0x7fc854007f30 comp rx=0 tx=0).stop 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 shutdown_connections 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc84c060550 0x7fc84c062a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86006f300 0x7fc8600b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc86006d670 0x7fc8600af610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 --2- 172.21.15.57:0/1217906988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86006cc60 0x7fc860152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 >> 172.21.15.57:0/1217906988 conn(0x7fc860068180 msgr2=0x7fc8601420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 shutdown_connections 2023-10-06T03:53:53.777 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.771+0000 7fc8652af700 1 -- 172.21.15.57:0/1217906988 wait complete. 2023-10-06T03:53:53.786 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:53:53.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 Processor -- start 2023-10-06T03:53:53.896 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 -- start start 2023-10-06T03:53:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd3640abfe0 0x7fd364145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36406e3d0 con 0x7fd3640b2440 2023-10-06T03:53:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd36406dd80 con 0x7fd36406e860 2023-10-06T03:53:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.891+0000 7fd368e03700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3640b1da0 con 0x7fd3640abfe0 2023-10-06T03:53:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3637fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3640b2440 0x7fd3640ab8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34672/0 (socket says 172.21.15.57:34672) 2023-10-06T03:53:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3637fe700 1 -- 172.21.15.57:0/2490679413 learned_addr learned my addr 172.21.15.57:0/2490679413 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:53.898 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2490679413 >> v2:172.21.15.105:3300/0 conn(0x7fd3640abfe0 0x7fd364145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785404946 0 0) 0x7fd36406e3d0 con 0x7fd3640b2440 2023-10-06T03:53:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd350003570 con 0x7fd3640b2440 2023-10-06T03:53:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333055423 0 0) 0x7fd36406dd80 con 0x7fd36406e860 2023-10-06T03:53:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd36406e3d0 con 0x7fd36406e860 2023-10-06T03:53:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd362ffd700 1 -- 172.21.15.57:0/2490679413 >> v1:172.21.15.105:6789/0 conn(0x7fd36406e860 legacy=0x7fd36414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd362ffd700 1 -- 172.21.15.57:0/2490679413 >> v1:172.21.15.57:6789/0 conn(0x7fd3640b2440 legacy=0x7fd3640ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd362ffd700 1 -- 172.21.15.57:0/2490679413 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36406daa0 con 0x7fd3640abfe0 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2490679413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364145820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098e0 tx=0x7fd3540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b20920ae260dec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011630 con 0x7fd3640abfe0 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354011790 con 0x7fd3640abfe0 2023-10-06T03:53:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd3627fc700 1 -- 172.21.15.57:0/2490679413 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011b30 con 0x7fd3640abfe0 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 -- 172.21.15.57:0/2490679413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 msgr2=0x7fd364145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 --2- 172.21.15.57:0/2490679413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364145820 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098e0 tx=0x7fd3540091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 -- 172.21.15.57:0/2490679413 shutdown_connections 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 --2- 172.21.15.57:0/2490679413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364145820 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 -- 172.21.15.57:0/2490679413 >> 172.21.15.57:0/2490679413 conn(0x7fd364068180 msgr2=0x7fd364068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 -- 172.21.15.57:0/2490679413 shutdown_connections 2023-10-06T03:53:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.895+0000 7fd368e03700 1 -- 172.21.15.57:0/2490679413 wait complete. 2023-10-06T03:53:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 Processor -- start 2023-10-06T03:53:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 -- start start 2023-10-06T03:53:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 0x7fd3641525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640a93e0 con 0x7fd36406e860 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641554c0 con 0x7fd3640abfe0 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36413bcd0 con 0x7fd3640b2440 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46054/0 (socket says 172.21.15.57:46054) 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 -- 172.21.15.57:0/2314096746 learned_addr learned my addr 172.21.15.57:0/2314096746 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd363fff700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 0x7fd3641525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 -- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 msgr2=0x7fd3641525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 0x7fd3641525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 -- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 msgr2=0x7fd364155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 -- 172.21.15.57:0/2314096746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009420 con 0x7fd36406e860 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd363fff700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 0x7fd3641525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd3637fe700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c790 tx=0x7fd34c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c005b30 con 0x7fd36406e860 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c005c90 con 0x7fd36406e860 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36413f5a0 con 0x7fd36406e860 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.899+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0072e0 con 0x7fd36406e860 2023-10-06T03:53:53.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3640aef50 con 0x7fd36406e860 2023-10-06T03:53:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36406c460 con 0x7fd36406e860 2023-10-06T03:53:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd34c01b3b0 con 0x7fd36406e860 2023-10-06T03:53:53.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd35b7fe700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 0x7fd344062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd34c07bcb0 con 0x7fd36406e860 2023-10-06T03:53:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.903+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 0x7fd344062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:53.909 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.907+0000 7fd362ffd700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 0x7fd344062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3640ac440 tx=0x7fd354017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:53.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:53.915+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd34c049be0 con 0x7fd36406e860 2023-10-06T03:53:54.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd36404b5c0 con 0x7fd36406e860 2023-10-06T03:53:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd35b7fe700 1 -- 172.21.15.57:0/2314096746 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd34c017020 con 0x7fd36406e860 2023-10-06T03:53:54.066 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 msgr2=0x7fd344062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 0x7fd344062a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd3640ac440 tx=0x7fd354017000 comp rx=0 tx=0).stop 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 msgr2=0x7fd3640ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00c790 tx=0x7fd34c007ea0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 shutdown_connections 2023-10-06T03:53:54.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd344060550 0x7fd344062a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3640b2440 0x7fd3641525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3640abfe0 0x7fd364155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 --2- 172.21.15.57:0/2314096746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd36406e860 0x7fd3640ae500 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 >> 172.21.15.57:0/2314096746 conn(0x7fd364068180 msgr2=0x7fd3640677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 shutdown_connections 2023-10-06T03:53:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.063+0000 7fd368e03700 1 -- 172.21.15.57:0/2314096746 wait complete. 2023-10-06T03:53:54.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:53:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.187+0000 7f458215c700 1 Processor -- start 2023-10-06T03:53:54.192 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.187+0000 7f458215c700 1 -- start start 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f457c06e450 0x7f457c06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 0x7f457c141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c06dc50 con 0x7f457c142130 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c06cde0 con 0x7f457c06e450 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c13e9c0 con 0x7f457c06e820 2023-10-06T03:53:54.194 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f457c06e450 0x7f457c06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f457c06e450 0x7f457c06c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46066/0 (socket says 172.21.15.57:46066) 2023-10-06T03:53:54.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 -- 172.21.15.57:0/4104946606 learned_addr learned my addr 172.21.15.57:0/4104946606 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:54.195 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f4580959700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 0x7f457c141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 -- 172.21.15.57:0/4104946606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 msgr2=0x7f457c141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:54.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 0x7f457c141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.196 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 -- 172.21.15.57:0/4104946606 >> v1:172.21.15.105:6789/0 conn(0x7f457c142130 legacy=0x7f457c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 -- 172.21.15.57:0/4104946606 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c13eca0 con 0x7f457c06e450 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f4580959700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 0x7f457c141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458115a700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e450 0x7f457c06c8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f457800ab40 tx=0x7f457800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1e37aeb53c7039 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f4573fff700 1 -- 172.21.15.57:0/4104946606 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800caa0 con 0x7f457c06e450 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f4573fff700 1 -- 172.21.15.57:0/4104946606 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800cc00 con 0x7f457c06e450 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f4573fff700 1 -- 172.21.15.57:0/4104946606 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578018400 con 0x7f457c06e450 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- 172.21.15.57:0/4104946606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e450 msgr2=0x7f457c06c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e450 0x7f457c06c8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f457800ab40 tx=0x7f457800a3f0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- 172.21.15.57:0/4104946606 shutdown_connections 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e820 0x7f457c141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.197 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 --2- 172.21.15.57:0/4104946606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e450 0x7f457c06c8a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- 172.21.15.57:0/4104946606 >> 172.21.15.57:0/4104946606 conn(0x7f457c0b1a90 msgr2=0x7f457c0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- 172.21.15.57:0/4104946606 shutdown_connections 2023-10-06T03:53:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.191+0000 7f458215c700 1 -- 172.21.15.57:0/4104946606 wait complete. 2023-10-06T03:53:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 Processor -- start 2023-10-06T03:53:54.198 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 -- start start 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e450 0x7f457c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f457c142130 0x7f457c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c13b650 con 0x7f457c06e820 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c139dc0 con 0x7f457c142130 2023-10-06T03:53:54.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458215c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0ac4f0 con 0x7f457c06e450 2023-10-06T03:53:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46082/0 (socket says 172.21.15.57:46082) 2023-10-06T03:53:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 -- 172.21.15.57:0/869255334 learned_addr learned my addr 172.21.15.57:0/869255334 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458115a700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e450 0x7f457c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f458195b700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f457c142130 0x7f457c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 -- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e450 msgr2=0x7f457c0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e450 0x7f457c0b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 -- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f457c142130 msgr2=0x7f457c1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f457c142130 0x7f457c1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.202 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 -- 172.21.15.57:0/869255334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457800a630 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f4580959700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f456c00e920 tx=0x7f456c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c013410 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.195+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c013570 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.199+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c0ac6f0 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.199+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c013930 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.199+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c139760 con 0x7f457c06e820 2023-10-06T03:53:54.203 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.199+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c13b2d0 con 0x7f457c06e820 2023-10-06T03:53:54.204 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.199+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f456c013ca0 con 0x7f457c06e820 2023-10-06T03:53:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.203+0000 7f45717fa700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 0x7f4560062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.203+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f456c07c6f0 con 0x7f457c06e820 2023-10-06T03:53:54.205 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.203+0000 7f458115a700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 0x7f4560062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.209 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.203+0000 7f458115a700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 0x7f4560062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f457800ab40 tx=0x7f457801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.212 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.207+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f456c04cae0 con 0x7f457c06e820 2023-10-06T03:53:54.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f457c04b5c0 con 0x7f457c06e820 2023-10-06T03:53:54.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f45717fa700 1 -- 172.21.15.57:0/869255334 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f456c050100 con 0x7f457c06e820 2023-10-06T03:53:54.371 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:53:54.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 msgr2=0x7f4560062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.374 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 0x7f4560062a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f457800ab40 tx=0x7f457801a000 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 msgr2=0x7f457c14fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f456c00e920 tx=0x7f456c008040 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 shutdown_connections 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4560060550 0x7f4560062a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f457c142130 0x7f457c1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f457c06e820 0x7f457c14fd60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 --2- 172.21.15.57:0/869255334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f457c06e450 0x7f457c0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.375 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 >> 172.21.15.57:0/869255334 conn(0x7f457c0b1a90 msgr2=0x7f457c067070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.367+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 shutdown_connections 2023-10-06T03:53:54.376 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.371+0000 7f458215c700 1 -- 172.21.15.57:0/869255334 wait complete. 2023-10-06T03:53:54.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:53:54.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 Processor -- start 2023-10-06T03:53:54.494 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 -- start start 2023-10-06T03:53:54.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61d00b05f0 0x7f61d00abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b1530 0x7f61d00ac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.495 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00ae9a0 con 0x7f61d00ad480 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00ae140 con 0x7f61d00b05f0 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cf59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00ad9d0 con 0x7f61d00b1530 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cdd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f61d00ad480 0x7f61d00af0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34674/0 (socket says 172.21.15.57:34674) 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cdd9b700 1 -- 172.21.15.57:0/2954828179 learned_addr learned my addr 172.21.15.57:0/2954828179 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 --2- 172.21.15.57:0/2954828179 >> v2:172.21.15.105:3300/0 conn(0x7f61d00b05f0 0x7f61d00abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ced9d700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b1530 0x7f61d00ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cd59a700 1 -- 172.21.15.57:0/2954828179 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188662324 0 0) 0x7f61d00ae9a0 con 0x7f61d00ad480 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cd59a700 1 -- 172.21.15.57:0/2954828179 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61bc003570 con 0x7f61d00ad480 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 -- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b1530 msgr2=0x7f61d00ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b1530 0x7f61d00ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.496 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 -- 172.21.15.57:0/2954828179 >> v1:172.21.15.57:6789/0 conn(0x7f61d00ad480 legacy=0x7f61d00af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.497 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 -- 172.21.15.57:0/2954828179 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00ae350 con 0x7f61d00b05f0 2023-10-06T03:53:54.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61ce59c700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00b05f0 0x7f61d00abcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098e0 tx=0x7f61b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22d2c7e1ed720f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cd59a700 1 -- 172.21.15.57:0/2954828179 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011630 con 0x7f61d00b05f0 2023-10-06T03:53:54.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cd59a700 1 -- 172.21.15.57:0/2954828179 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8011790 con 0x7f61d00b05f0 2023-10-06T03:53:54.498 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.491+0000 7f61cd59a700 1 -- 172.21.15.57:0/2954828179 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011b10 con 0x7f61d00b05f0 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00b05f0 msgr2=0x7f61d00abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00b05f0 0x7f61d00abcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098e0 tx=0x7f61b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- 172.21.15.57:0/2954828179 shutdown_connections 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b1530 0x7f61d00ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- 172.21.15.57:0/2954828179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00b05f0 0x7f61d00abcc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- 172.21.15.57:0/2954828179 >> 172.21.15.57:0/2954828179 conn(0x7f61d0067070 msgr2=0x7f61d0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.499 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- 172.21.15.57:0/2954828179 shutdown_connections 2023-10-06T03:53:54.501 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- 172.21.15.57:0/2954828179 wait complete. 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 Processor -- start 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- start start 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 0x7f61d006e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b05f0 0x7f61d0156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d006e5c0 con 0x7f61d00b1530 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0156440 con 0x7f61d00ad480 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cf59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0156720 con 0x7f61d00b05f0 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46094/0 (socket says 172.21.15.57:46094) 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 -- 172.21.15.57:0/433441724 learned_addr learned my addr 172.21.15.57:0/433441724 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61cdd9b700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b05f0 0x7f61d0156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ce59c700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 0x7f61d006e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 -- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b05f0 msgr2=0x7f61d0156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b05f0 0x7f61d0156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 -- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 msgr2=0x7f61d006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 0x7f61d006e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 -- 172.21.15.57:0/433441724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8009420 con 0x7f61d00b1530 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ce59c700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 0x7f61d006e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61ced9d700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e8d0 tx=0x7f61c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0013680 con 0x7f61d00b1530 2023-10-06T03:53:54.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.495+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c00137e0 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0157180 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0013ba0 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d011d030 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d006b3a0 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f61c00123d0 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61c67fc700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 0x7f61b0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f61c007ca60 con 0x7f61d00b1530 2023-10-06T03:53:54.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61ce59c700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 0x7f61b0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.499+0000 7f61ce59c700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 0x7f61b0062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61b80091e0 tx=0x7f61b8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.510 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.507+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61c004cef0 con 0x7f61d00b1530 2023-10-06T03:53:54.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.703+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61d00a4530 con 0x7f61d00b1530 2023-10-06T03:53:54.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61c67fc700 1 -- 172.21.15.57:0/433441724 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f61c0017c20 con 0x7f61d00b1530 2023-10-06T03:53:54.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:54.710 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:53:54.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 msgr2=0x7f61b0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 0x7f61b0062a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61b80091e0 tx=0x7f61b8017000 comp rx=0 tx=0).stop 2023-10-06T03:53:54.714 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 msgr2=0x7f61d011caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61c000e8d0 tx=0x7f61c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.715 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 shutdown_connections 2023-10-06T03:53:54.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f61b0060550 0x7f61b0062a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61d00b1530 0x7f61d011caf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61d00b05f0 0x7f61d0156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 --2- 172.21.15.57:0/433441724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61d00ad480 0x7f61d006e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.707+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 >> 172.21.15.57:0/433441724 conn(0x7f61d0067070 msgr2=0x7f61d014c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.711+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 shutdown_connections 2023-10-06T03:53:54.717 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.711+0000 7f61cf59e700 1 -- 172.21.15.57:0/433441724 wait complete. 2023-10-06T03:53:54.718 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:53:54.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 Processor -- start 2023-10-06T03:53:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- start start 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb29c0add20 0x7fb29c13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c143f30 con 0x7fb29c0a7df0 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0a9410 con 0x7fb29c140450 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c0a9230 con 0x7fb29c0add20 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb299d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb29c0a7df0 0x7fb29c06ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34688/0 (socket says 172.21.15.57:34688) 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb299d9b700 1 -- 172.21.15.57:0/1000485659 learned_addr learned my addr 172.21.15.57:0/1000485659 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29a59c700 1 --2- 172.21.15.57:0/1000485659 >> v2:172.21.15.57:3300/0 conn(0x7fb29c0add20 0x7fb29c13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736735752 0 0) 0x7fb29c143f30 con 0x7fb29c0a7df0 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb284003570 con 0x7fb29c0a7df0 2023-10-06T03:53:54.835 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280490733 0 0) 0x7fb29c0a9410 con 0x7fb29c140450 2023-10-06T03:53:54.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29a59c700 1 -- 172.21.15.57:0/1000485659 >> v1:172.21.15.105:6789/0 conn(0x7fb29c140450 legacy=0x7fb29c0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29a59c700 1 -- 172.21.15.57:0/1000485659 >> v1:172.21.15.57:6789/0 conn(0x7fb29c0a7df0 legacy=0x7fb29c06ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.836 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29a59c700 1 -- 172.21.15.57:0/1000485659 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c1443c0 con 0x7fb29c0add20 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29a59c700 1 --2- 172.21.15.57:0/1000485659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c0add20 0x7fb29c13ff10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb2900098e0 tx=0x7fb2900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b86b72d04aef24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011630 con 0x7fb29c0add20 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290011790 con 0x7fb29c0add20 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29959a700 1 -- 172.21.15.57:0/1000485659 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011b30 con 0x7fb29c0add20 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- 172.21.15.57:0/1000485659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c0add20 msgr2=0x7fb29c13ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 --2- 172.21.15.57:0/1000485659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c0add20 0x7fb29c13ff10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb2900098e0 tx=0x7fb2900091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- 172.21.15.57:0/1000485659 shutdown_connections 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 --2- 172.21.15.57:0/1000485659 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c0add20 0x7fb29c13ff10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- 172.21.15.57:0/1000485659 >> 172.21.15.57:0/1000485659 conn(0x7fb29c067070 msgr2=0x7fb29c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- 172.21.15.57:0/1000485659 shutdown_connections 2023-10-06T03:53:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.831+0000 7fb29b59e700 1 -- 172.21.15.57:0/1000485659 wait complete. 2023-10-06T03:53:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 Processor -- start 2023-10-06T03:53:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 -- start start 2023-10-06T03:53:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0a7df0 0x7fb29c13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c140450 0x7fb29c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1439e0 con 0x7fb29c14fb00 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c06e4a0 con 0x7fb29c140450 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c0a5810 con 0x7fb29c0a7df0 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46106/0 (socket says 172.21.15.57:46106) 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 -- 172.21.15.57:0/2499997232 learned_addr learned my addr 172.21.15.57:0/2499997232 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29a59c700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0a7df0 0x7fb29c13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.841 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb299d9b700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c140450 0x7fb29c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 -- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0a7df0 msgr2=0x7fb29c13f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0a7df0 0x7fb29c13f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 -- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c140450 msgr2=0x7fb29c153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:54.842 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c140450 0x7fb29c153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.835+0000 7fb29ad9d700 1 -- 172.21.15.57:0/2499997232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290009420 con 0x7fb29c14fb00 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb29ad9d700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb294001560 tx=0x7fb294001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294002060 con 0x7fb29c14fb00 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400a7e0 con 0x7fb29c14fb00 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c06e6f0 con 0x7fb29c14fb00 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400aba0 con 0x7fb29c14fb00 2023-10-06T03:53:54.843 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c0a4850 con 0x7fb29c14fb00 2023-10-06T03:53:54.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c06e8e0 con 0x7fb29c14fb00 2023-10-06T03:53:54.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb294003030 con 0x7fb29c14fb00 2023-10-06T03:53:54.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 0x7fb27c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:54.844 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb29407c7c0 con 0x7fb29c14fb00 2023-10-06T03:53:54.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.839+0000 7fb29a59c700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 0x7fb27c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:54.845 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.843+0000 7fb29a59c700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 0x7fb27c062a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0aea70 tx=0x7fb290016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:54.851 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:54.847+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb29404cc50 con 0x7fb29c14fb00 2023-10-06T03:53:55.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.011+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb29c143bc0 con 0x7fb29c14fb00 2023-10-06T03:53:55.017 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb28a7fc700 1 -- 172.21.15.57:0/2499997232 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fb294050270 con 0x7fb29c14fb00 2023-10-06T03:53:55.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:55.018 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:55.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 msgr2=0x7fb27c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 0x7fb27c062a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0aea70 tx=0x7fb290016000 comp rx=0 tx=0).stop 2023-10-06T03:53:55.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 msgr2=0x7fb29c14ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb294001560 tx=0x7fb294001770 comp rx=0 tx=0).stop 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 shutdown_connections 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb27c060580 0x7fb27c062a30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c14fb00 0x7fb29c14ff60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c140450 0x7fb29c153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 --2- 172.21.15.57:0/2499997232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0a7df0 0x7fb29c13f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 >> 172.21.15.57:0/2499997232 conn(0x7fb29c067070 msgr2=0x7fb29c139dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 shutdown_connections 2023-10-06T03:53:55.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.015+0000 7fb29b59e700 1 -- 172.21.15.57:0/2499997232 wait complete. 2023-10-06T03:53:55.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:53:32.687516+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:53:38.405877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:53:42.316403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:53:42.989663+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:53:55.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:53:55.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 Processor -- start 2023-10-06T03:53:55.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 -- start start 2023-10-06T03:53:55.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 0x7fb99013f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb99013cab0 0x7fb9901499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900b15d0 con 0x7fb99013f860 2023-10-06T03:53:55.149 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99013fc90 con 0x7fb99013cab0 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.143+0000 7fb997acb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99006ec50 con 0x7fb9900682b0 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb99013cab0 0x7fb9901499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb995867700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 0x7fb99013f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb99013cab0 0x7fb9901499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59762/0 (socket says 172.21.15.57:59762) 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb995066700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb99013f860 0x7fb99013c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:58466/0 (socket says 172.21.15.57:58466) 2023-10-06T03:53:55.150 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 -- 172.21.15.57:0/1768472857 learned_addr learned my addr 172.21.15.57:0/1768472857 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:55.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 -- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 msgr2=0x7fb99013f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:55.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 0x7fb99013f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 -- 172.21.15.57:0/1768472857 >> v1:172.21.15.105:6789/0 conn(0x7fb99013f860 legacy=0x7fb99013c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 -- 172.21.15.57:0/1768472857 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900b0f80 con 0x7fb99013cab0 2023-10-06T03:53:55.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb995867700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 0x7fb99013f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:55.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.147+0000 7fb996068700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013cab0 0x7fb9901499c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb988009f20 tx=0x7fb988009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7cb74097d7120 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.151+0000 7fb994865700 1 -- 172.21.15.57:0/1768472857 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800e070 con 0x7fb99013cab0 2023-10-06T03:53:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.151+0000 7fb994865700 1 -- 172.21.15.57:0/1768472857 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98800b9d0 con 0x7fb99013cab0 2023-10-06T03:53:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.151+0000 7fb994865700 1 -- 172.21.15.57:0/1768472857 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880092e0 con 0x7fb99013cab0 2023-10-06T03:53:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.151+0000 7fb997acb700 1 -- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013cab0 msgr2=0x7fb9901499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.157 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.151+0000 7fb997acb700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013cab0 0x7fb9901499c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb988009f20 tx=0x7fb988009840 comp rx=0 tx=0).stop 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- 172.21.15.57:0/1768472857 shutdown_connections 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013cab0 0x7fb9901499c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 --2- 172.21.15.57:0/1768472857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900682b0 0x7fb99013f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- 172.21.15.57:0/1768472857 >> 172.21.15.57:0/1768472857 conn(0x7fb9900b5c30 msgr2=0x7fb9900b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- 172.21.15.57:0/1768472857 shutdown_connections 2023-10-06T03:53:55.158 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- 172.21.15.57:0/1768472857 wait complete. 2023-10-06T03:53:55.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 Processor -- start 2023-10-06T03:53:55.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- start start 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99013cab0 0x7fb990151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 0x7fb990139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900adcf0 con 0x7fb9900682b0 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900b2f70 con 0x7fb99013f860 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb997acb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900adaf0 con 0x7fb99013cab0 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb995867700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb995867700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46116/0 (socket says 172.21.15.57:46116) 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb995867700 1 -- 172.21.15.57:0/3473380145 learned_addr learned my addr 172.21.15.57:0/3473380145 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:55.163 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.155+0000 7fb996068700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 0x7fb990139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995066700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99013cab0 0x7fb990151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 -- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99013cab0 msgr2=0x7fb990151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99013cab0 0x7fb990151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 -- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 msgr2=0x7fb990139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 0x7fb990139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 -- 172.21.15.57:0/3473380145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb980009420 con 0x7fb9900682b0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb996068700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 0x7fb990139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb995867700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb98000ecb0 tx=0x7fb9800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000c920 con 0x7fb9900682b0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98000ca80 con 0x7fb9900682b0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988009ae0 con 0x7fb9900682b0 2023-10-06T03:53:55.164 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98000ce00 con 0x7fb9900682b0 2023-10-06T03:53:55.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9900acb50 con 0x7fb9900682b0 2023-10-06T03:53:55.165 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.159+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9900b4d40 con 0x7fb9900682b0 2023-10-06T03:53:55.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.163+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb980013680 con 0x7fb9900682b0 2023-10-06T03:53:55.166 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.163+0000 7fb985ffb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 0x7fb974062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.163+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb98007cc80 con 0x7fb9900682b0 2023-10-06T03:53:55.167 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.163+0000 7fb995066700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 0x7fb974062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.168 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.163+0000 7fb995066700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 0x7fb974062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9900ac820 tx=0x7fb98c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.173 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.171+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb98004d070 con 0x7fb9900682b0 2023-10-06T03:53:55.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb99004be00 con 0x7fb9900682b0 2023-10-06T03:53:55.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb985ffb700 1 -- 172.21.15.57:0/3473380145 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb980050690 con 0x7fb9900682b0 2023-10-06T03:53:55.343 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 msgr2=0x7fb974062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 0x7fb974062a00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb9900ac820 tx=0x7fb98c007eb0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 msgr2=0x7fb9900ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb98000ecb0 tx=0x7fb9800091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 shutdown_connections 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb974060550 0x7fb974062a00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb99013f860 0x7fb990139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb99013cab0 0x7fb990151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 --2- 172.21.15.57:0/3473380145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9900682b0 0x7fb9900ae270 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 >> 172.21.15.57:0/3473380145 conn(0x7fb9900b5c30 msgr2=0x7fb99006c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.339+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 shutdown_connections 2023-10-06T03:53:55.346 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.343+0000 7fb997acb700 1 -- 172.21.15.57:0/3473380145 wait complete. 2023-10-06T03:53:55.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:53:55.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.467+0000 7ff1588d0700 1 Processor -- start 2023-10-06T03:53:55.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.467+0000 7ff1588d0700 1 -- start start 2023-10-06T03:53:55.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff1540af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1540b0b20 con 0x7ff154143af0 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff154067e90 con 0x7ff1541436a0 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1541445d0 con 0x7ff1540701c0 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff153fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff154143af0 0x7ff154067780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34692/0 (socket says 172.21.15.57:34692) 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff153fff700 1 -- 172.21.15.57:0/4159960743 learned_addr learned my addr 172.21.15.57:0/4159960743 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff1540af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140695410 0 0) 0x7ff1540b0b20 con 0x7ff154143af0 2023-10-06T03:53:55.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff13c003570 con 0x7ff154143af0 2023-10-06T03:53:55.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3839956401 0 0) 0x7ff13c003570 con 0x7ff154143af0 2023-10-06T03:53:55.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 msgr2=0x7ff1540af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff1540af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 >> v1:172.21.15.105:6789/0 conn(0x7ff1541436a0 legacy=0x7ff154067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540ac880 con 0x7ff154143af0 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7ff14c0017f0 con 0x7ff154143af0 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 >> v1:172.21.15.57:6789/0 conn(0x7ff154143af0 legacy=0x7ff154067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff13c003a90 0x7ff13c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff13c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00bb40 con 0x7ff13c003a90 2023-10-06T03:53:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00bcb0 con 0x7ff13c004d50 2023-10-06T03:53:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00be70 con 0x7ff1540701c0 2023-10-06T03:53:55.478 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff13c003a90 0x7ff13c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff153fff700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 -- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 msgr2=0x7ff13c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff152ffd700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff13c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff13c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 -- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff13c004d50 msgr2=0x7ff13c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 -- 172.21.15.57:0/4159960743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c003570 con 0x7ff13c003a90 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff153fff700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff152ffd700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1540701c0 0x7ff13c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:53:55.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1537fe700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff13c003a90 0x7ff13c003ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff144009bf0 tx=0x7ff144009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00a598eaed49074 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff144005a00 con 0x7ff13c003a90 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff144005b60 con 0x7ff13c003a90 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1527fc700 1 -- 172.21.15.57:0/4159960743 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14400e710 con 0x7ff13c003a90 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- 172.21.15.57:0/4159960743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff13c003a90 msgr2=0x7ff13c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 --2- 172.21.15.57:0/4159960743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff13c003a90 0x7ff13c003ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff144009bf0 tx=0x7ff144009120 comp rx=0 tx=0).stop 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff153fff700 1 -- 172.21.15.57:0/4159960743 reap_dead start 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- 172.21.15.57:0/4159960743 shutdown_connections 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- 172.21.15.57:0/4159960743 >> 172.21.15.57:0/4159960743 conn(0x7ff1540b1a90 msgr2=0x7ff1540b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- 172.21.15.57:0/4159960743 shutdown_connections 2023-10-06T03:53:55.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.471+0000 7ff1588d0700 1 -- 172.21.15.57:0/4159960743 wait complete. 2023-10-06T03:53:55.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 Processor -- start 2023-10-06T03:53:55.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- start start 2023-10-06T03:53:55.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff154142f90 0x7ff154152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff154155580 0x7ff154155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff154152000 con 0x7ff1540ad080 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540ae020 con 0x7ff154155580 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540aedd0 con 0x7ff154142f90 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46130/0 (socket says 172.21.15.57:46130) 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 -- 172.21.15.57:0/3196233576 learned_addr learned my addr 172.21.15.57:0/3196233576 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff153fff700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff154155580 0x7ff154155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1537fe700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff154142f90 0x7ff154152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 -- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff154142f90 msgr2=0x7ff154152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff154142f90 0x7ff154152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 -- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff154155580 msgr2=0x7ff154155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff154155580 0x7ff154155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 -- 172.21.15.57:0/3196233576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540af0b0 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff152ffd700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff14800d830 tx=0x7ff148009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148006820 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff148006980 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff154143360 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148006d20 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15406e170 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.475+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15406b9a0 con 0x7ff1540ad080 2023-10-06T03:53:55.485 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.479+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7ff148007230 con 0x7ff1540ad080 2023-10-06T03:53:55.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.479+0000 7ff13b7fe700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 0x7ff140062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.479+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff14807cda0 con 0x7ff1540ad080 2023-10-06T03:53:55.486 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.479+0000 7ff1537fe700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 0x7ff140062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.487 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.483+0000 7ff1537fe700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 0x7ff140062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff154068920 tx=0x7ff144019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.487+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff14804d210 con 0x7ff1540ad080 2023-10-06T03:53:55.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.647+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1540af240 con 0x7ff1540ad080 2023-10-06T03:53:55.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.647+0000 7ff13b7fe700 1 -- 172.21.15.57:0/3196233576 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff148001e60 con 0x7ff1540ad080 2023-10-06T03:53:55.651 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2023-10-06T03:53:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 msgr2=0x7ff140062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 0x7ff140062a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff154068920 tx=0x7ff144019000 comp rx=0 tx=0).stop 2023-10-06T03:53:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 msgr2=0x7ff1541529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff14800d830 tx=0x7ff148009040 comp rx=0 tx=0).stop 2023-10-06T03:53:55.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 shutdown_connections 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7ff140060580 0x7ff140062a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff154155580 0x7ff154155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1540ad080 0x7ff1541529d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 --2- 172.21.15.57:0/3196233576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff154142f90 0x7ff154152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 >> 172.21.15.57:0/3196233576 conn(0x7ff1540b1a90 msgr2=0x7ff15413e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 shutdown_connections 2023-10-06T03:53:55.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.651+0000 7ff1588d0700 1 -- 172.21.15.57:0/3196233576 wait complete. 2023-10-06T03:53:55.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:53:55.781 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 Processor -- start 2023-10-06T03:53:55.782 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 -- start start 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43680b52a0 0x7f436813ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680b4e10 con 0x7f43680b0cd0 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680b1160 con 0x7f43680b52a0 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b1440 con 0x7f43680672a0 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43680b52a0 0x7f436813ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.783 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436c9db700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43680b52a0 0x7f436813ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:59802/0 (socket says 172.21.15.57:59802) 2023-10-06T03:53:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 -- 172.21.15.57:0/3838722464 learned_addr learned my addr 172.21.15.57:0/3838722464 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:55.784 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436c9db700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:40224/0 (socket says 172.21.15.57:40224) 2023-10-06T03:53:55.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 -- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 msgr2=0x7f43681422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:55.785 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 -- 172.21.15.57:0/3838722464 >> v1:172.21.15.105:6789/0 conn(0x7f43680b0cd0 legacy=0x7f43680b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 -- 172.21.15.57:0/3838722464 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368142830 con 0x7f43680b52a0 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436c9db700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436d1dc700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b52a0 0x7f436813ee90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4360009f20 tx=0x7f4360009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a60c60e25540eff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f43677fe700 1 -- 172.21.15.57:0/3838722464 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000e070 con 0x7f43680b52a0 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f43677fe700 1 -- 172.21.15.57:0/3838722464 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000b9d0 con 0x7f43680b52a0 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f43677fe700 1 -- 172.21.15.57:0/3838722464 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43600092e0 con 0x7f43680b52a0 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 -- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b52a0 msgr2=0x7f436813ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.779+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b52a0 0x7f436813ee90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4360009f20 tx=0x7f4360009840 comp rx=0 tx=0).stop 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- 172.21.15.57:0/3838722464 shutdown_connections 2023-10-06T03:53:55.786 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b52a0 0x7f436813ee90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3838722464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680672a0 0x7f43681422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- 172.21.15.57:0/3838722464 >> 172.21.15.57:0/3838722464 conn(0x7f43680b8d30 msgr2=0x7f43680b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- 172.21.15.57:0/3838722464 shutdown_connections 2023-10-06T03:53:55.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- 172.21.15.57:0/3838722464 wait complete. 2023-10-06T03:53:55.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 Processor -- start 2023-10-06T03:53:55.789 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- start start 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680672a0 0x7f4368152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b52a0 0x7f436813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4368152b60 con 0x7f43680b0cd0 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4368152660 con 0x7f43680672a0 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436ec3f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43681553f0 con 0x7f43680b52a0 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46134/0 (socket says 172.21.15.57:46134) 2023-10-06T03:53:55.790 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 -- 172.21.15.57:0/3893472512 learned_addr learned my addr 172.21.15.57:0/3893472512 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436c9db700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680672a0 0x7f4368152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f436d1dc700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b52a0 0x7f436813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 -- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b52a0 msgr2=0x7f436813e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b52a0 0x7f436813e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 -- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680672a0 msgr2=0x7f4368152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680672a0 0x7f4368152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 -- 172.21.15.57:0/3893472512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c009420 con 0x7f43680b0cd0 2023-10-06T03:53:55.791 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4367fff700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f435400c5c0 tx=0x7f435400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.783+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354011590 con 0x7f43680b0cd0 2023-10-06T03:53:55.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354011710 con 0x7f43680b0cd0 2023-10-06T03:53:55.792 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360009ae0 con 0x7f43680b0cd0 2023-10-06T03:53:55.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354011ad0 con 0x7f43680b0cd0 2023-10-06T03:53:55.793 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4368152880 con 0x7f43680b0cd0 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436804be00 con 0x7f43680b0cd0 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f435401b3b0 con 0x7f43680b0cd0 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f4364ff9700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 0x7f434c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f435407bdd0 con 0x7f43680b0cd0 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f436c9db700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 0x7f434c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:55.794 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.787+0000 7f436c9db700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 0x7f434c062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f435c009f40 tx=0x7f435c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:55.800 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.795+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f435404c260 con 0x7f43680b0cd0 2023-10-06T03:53:55.962 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4368155530 con 0x7f43680b0cd0 2023-10-06T03:53:55.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f4364ff9700 1 -- 172.21.15.57:0/3893472512 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43540170a0 con 0x7f43680b0cd0 2023-10-06T03:53:55.963 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 msgr2=0x7f434c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 0x7f434c062a00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f435c009f40 tx=0x7f435c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 msgr2=0x7f4368155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f435400c5c0 tx=0x7f435400c8d0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 shutdown_connections 2023-10-06T03:53:55.967 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f434c060550 0x7f434c062a00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b52a0 0x7f436813e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43680b0cd0 0x7f4368155880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 --2- 172.21.15.57:0/3893472512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680672a0 0x7f4368152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.959+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 >> 172.21.15.57:0/3893472512 conn(0x7f43680b8d30 msgr2=0x7f43680b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.963+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 shutdown_connections 2023-10-06T03:53:55.968 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:55.963+0000 7f436ec3f700 1 -- 172.21.15.57:0/3893472512 wait complete. 2023-10-06T03:53:55.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:53:56.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 Processor -- start 2023-10-06T03:53:56.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 -- start start 2023-10-06T03:53:56.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7eb40b2650 0x7f7eb40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb4145710 con 0x7f7eb40abb40 2023-10-06T03:53:56.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb4145fb0 con 0x7f7eb40b2a20 2023-10-06T03:53:56.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb9cb2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40b1f50 con 0x7f7eb40b2650 2023-10-06T03:53:56.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb8cb0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7eb40b2650 0x7f7eb40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.091+0000 7f7eb94b1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7eb40abb40 0x7f7eb414cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34706/0 (socket says 172.21.15.57:34706) 2023-10-06T03:53:56.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb8cb0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7eb40b2650 0x7f7eb40b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46142/0 (socket says 172.21.15.57:46142) 2023-10-06T03:53:56.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb94b1700 1 -- 172.21.15.57:0/2113571795 learned_addr learned my addr 172.21.15.57:0/2113571795 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb8cb0700 1 -- 172.21.15.57:0/2113571795 >> v1:172.21.15.105:6789/0 conn(0x7f7eb40b2a20 legacy=0x7f7eb4142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb8cb0700 1 -- 172.21.15.57:0/2113571795 >> v1:172.21.15.57:6789/0 conn(0x7f7eb40abb40 legacy=0x7f7eb414cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb37fe700 1 -- 172.21.15.57:0/2113571795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465983872 0 0) 0x7f7eb4145710 con 0x7f7eb40abb40 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb8cb0700 1 -- 172.21.15.57:0/2113571795 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb41428a0 con 0x7f7eb40b2650 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb8cb0700 1 --2- 172.21.15.57:0/2113571795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2650 0x7f7eb40b0c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85201855e7bc9a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb37fe700 1 -- 172.21.15.57:0/2113571795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c009e80 con 0x7f7eb40b2650 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb37fe700 1 -- 172.21.15.57:0/2113571795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00b860 con 0x7f7eb40b2650 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb37fe700 1 -- 172.21.15.57:0/2113571795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00bbe0 con 0x7f7eb40b2650 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/2113571795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2650 msgr2=0x7f7eb40b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/2113571795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2650 0x7f7eb40b0c10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/2113571795 shutdown_connections 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/2113571795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2650 0x7f7eb40b0c10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/2113571795 >> 172.21.15.57:0/2113571795 conn(0x7f7eb4068f20 msgr2=0x7f7eb4069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/2113571795 shutdown_connections 2023-10-06T03:53:56.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/2113571795 wait complete. 2023-10-06T03:53:56.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.095+0000 7f7eb9cb2700 1 Processor -- start 2023-10-06T03:53:56.103 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- start start 2023-10-06T03:53:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb40abb40 0x7f7eb413ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eb40b2650 0x7f7eb4155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb413f690 con 0x7f7eb40b2a20 2023-10-06T03:53:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb413d990 con 0x7f7eb40abb40 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb413dc30 con 0x7f7eb40b2650 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46156/0 (socket says 172.21.15.57:46156) 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 -- 172.21.15.57:0/3981590306 learned_addr learned my addr 172.21.15.57:0/3981590306 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb3fff700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eb40b2650 0x7f7eb4155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb8cb0700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb40abb40 0x7f7eb413ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 -- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eb40b2650 msgr2=0x7f7eb4155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eb40b2650 0x7f7eb4155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 -- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb40abb40 msgr2=0x7f7eb413ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb40abb40 0x7f7eb413ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 -- 172.21.15.57:0/3981590306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009420 con 0x7f7eb40b2a20 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb94b1700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cc90 tx=0x7f7eac001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00a870 con 0x7f7eb40b2a20 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00a9d0 con 0x7f7eb40b2a20 2023-10-06T03:53:56.107 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb413df10 con 0x7f7eb40b2a20 2023-10-06T03:53:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00ad90 con 0x7f7eb40b2a20 2023-10-06T03:53:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.099+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb413e450 con 0x7f7eb40b2a20 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7eac007300 con 0x7f7eb40b2a20 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb406a020 con 0x7f7eb40b2a20 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb0ff9700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 0x7f7e94062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7eac07ccb0 con 0x7f7eb40b2a20 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb8cb0700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 0x7f7e94062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.103+0000 7f7eb8cb0700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 0x7f7e94062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0093f0 tx=0x7f7e9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.111 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.107+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7eac04d0b0 con 0x7f7eb40b2a20 2023-10-06T03:53:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.267+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7eb4145960 con 0x7f7eb40b2a20 2023-10-06T03:53:56.272 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.267+0000 7f7eb0ff9700 1 -- 172.21.15.57:0/3981590306 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7eac0506d0 con 0x7f7eb40b2a20 2023-10-06T03:53:56.273 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 msgr2=0x7f7e94062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 0x7f7e94062a00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0093f0 tx=0x7f7e9c017000 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 msgr2=0x7f7eb4155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00cc90 tx=0x7f7eac001a20 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 shutdown_connections 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7e94060550 0x7f7e94062a00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb40b2a20 0x7f7eb4155c90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7eb40b2650 0x7f7eb4155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 --2- 172.21.15.57:0/3981590306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7eb40abb40 0x7f7eb413ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 >> 172.21.15.57:0/3981590306 conn(0x7f7eb4068f20 msgr2=0x7f7eb413c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 shutdown_connections 2023-10-06T03:53:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.271+0000 7f7eb9cb2700 1 -- 172.21.15.57:0/3981590306 wait complete. 2023-10-06T03:53:56.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:53:56.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 Processor -- start 2023-10-06T03:53:56.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 -- start start 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdd3c0ae5f0 0x7fdd3c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd3c0ac7b0 0x7fdd3c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0b1470 con 0x7fdd3c0af760 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0abee0 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd42bc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0abc90 con 0x7fdd3c0ac7b0 2023-10-06T03:53:56.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd41161700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdd3c0af760 0x7fdd3c150360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34708/0 (socket says 172.21.15.57:34708) 2023-10-06T03:53:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd41161700 1 -- 172.21.15.57:0/545541975 learned_addr learned my addr 172.21.15.57:0/545541975 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:56.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 --2- 172.21.15.57:0/545541975 >> v2:172.21.15.57:3300/0 conn(0x7fdd3c0ae5f0 0x7fdd3c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3bfff700 1 --2- 172.21.15.57:0/545541975 >> v2:172.21.15.105:3300/0 conn(0x7fdd3c0ac7b0 0x7fdd3c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115078076 0 0) 0x7fdd3c0b1470 con 0x7fdd3c0af760 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd1c003570 con 0x7fdd3c0af760 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 -- 172.21.15.57:0/545541975 >> v2:172.21.15.105:3300/0 conn(0x7fdd3c0ac7b0 msgr2=0x7fdd3c0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 --2- 172.21.15.57:0/545541975 >> v2:172.21.15.105:3300/0 conn(0x7fdd3c0ac7b0 0x7fdd3c0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 -- 172.21.15.57:0/545541975 >> v1:172.21.15.57:6789/0 conn(0x7fdd3c0af760 legacy=0x7fdd3c150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3971490765 0 0) 0x7fdd1c003570 con 0x7fdd3c0af760 2023-10-06T03:53:56.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 -- 172.21.15.57:0/545541975 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0b0770 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd40960700 1 --2- 172.21.15.57:0/545541975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0ac270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c068150 tx=0x7fdd2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adacb1e1930640d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c00e070 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c00b7a0 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.387+0000 7fdd3b7fe700 1 -- 172.21.15.57:0/545541975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34001490 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- 172.21.15.57:0/545541975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0ae5f0 msgr2=0x7fdd3c0ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/545541975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0ac270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c068150 tx=0x7fdd2c009780 comp rx=0 tx=0).stop 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- 172.21.15.57:0/545541975 shutdown_connections 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/545541975 >> v2:172.21.15.105:3300/0 conn(0x7fdd3c0ac7b0 0x7fdd3c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/545541975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0ac270 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- 172.21.15.57:0/545541975 >> 172.21.15.57:0/545541975 conn(0x7fdd3c067070 msgr2=0x7fdd3c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- 172.21.15.57:0/545541975 shutdown_connections 2023-10-06T03:53:56.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- 172.21.15.57:0/545541975 wait complete. 2023-10-06T03:53:56.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 Processor -- start 2023-10-06T03:53:56.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- start start 2023-10-06T03:53:56.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd3c0ac7b0 0x7fdd3c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c11fe10 con 0x7fdd3c0af760 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c11fba0 con 0x7fdd3c0ac7b0 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd42bc4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c11c5e0 con 0x7fdd3c0ae5f0 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd41161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd41161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46176/0 (socket says 172.21.15.57:46176) 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd41161700 1 -- 172.21.15.57:0/1077075819 learned_addr learned my addr 172.21.15.57:0/1077075819 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:56.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd3bfff700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.391+0000 7fdd40960700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd3c0ac7b0 0x7fdd3c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 -- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd3c0ae5f0 msgr2=0x7fdd3c0a9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0a9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 -- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd3c0ac7b0 msgr2=0x7fdd3c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd3c0ac7b0 0x7fdd3c159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 -- 172.21.15.57:0/1077075819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009a20 con 0x7fdd3c0af760 2023-10-06T03:53:56.399 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd41161700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001200 tx=0x7fdd34001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34007360 con 0x7fdd3c0af760 2023-10-06T03:53:56.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34007500 con 0x7fdd3c0af760 2023-10-06T03:53:56.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c15a460 con 0x7fdd3c0af760 2023-10-06T03:53:56.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34004a80 con 0x7fdd3c0af760 2023-10-06T03:53:56.400 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c15a090 con 0x7fdd3c0af760 2023-10-06T03:53:56.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.395+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c04be00 con 0x7fdd3c0af760 2023-10-06T03:53:56.401 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.399+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fdd3401c3b0 con 0x7fdd3c0af760 2023-10-06T03:53:56.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.399+0000 7fdd38ff9700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 0x7fdd20062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.399+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd3407bfc0 con 0x7fdd3c0af760 2023-10-06T03:53:56.402 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.399+0000 7fdd40960700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 0x7fdd20062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.399+0000 7fdd40960700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 0x7fdd20062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0097c0 tx=0x7fdd2c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.403+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd3404c4d0 con 0x7fdd3c0af760 2023-10-06T03:53:56.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.599+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd3c0b1900 con 0x7fdd3c0af760 2023-10-06T03:53:56.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd38ff9700 1 -- 172.21.15.57:0/1077075819 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fdd34018c20 con 0x7fdd3c0af760 2023-10-06T03:53:56.605 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:56.606 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:53:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 msgr2=0x7fdd20062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 0x7fdd20062a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0097c0 tx=0x7fdd2c018000 comp rx=0 tx=0).stop 2023-10-06T03:53:56.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 msgr2=0x7fdd3c0a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd34001200 tx=0x7fdd34001a30 comp rx=0 tx=0).stop 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 shutdown_connections 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fdd20060550 0x7fdd20062a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd3c0af760 0x7fdd3c0a9ab0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd3c0ae5f0 0x7fdd3c0a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 --2- 172.21.15.57:0/1077075819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd3c0ac7b0 0x7fdd3c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 >> 172.21.15.57:0/1077075819 conn(0x7fdd3c067070 msgr2=0x7fdd3c062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 shutdown_connections 2023-10-06T03:53:56.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.603+0000 7fdd42bc4700 1 -- 172.21.15.57:0/1077075819 wait complete. 2023-10-06T03:53:56.610 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:53:56.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:53:56.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 Processor -- start 2023-10-06T03:53:56.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- start start 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f07f40b1190 0x7f07f4145f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40b05f0 con 0x7f07f40ae400 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40acc50 con 0x7f07f40b1190 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40ad9d0 con 0x7f07f40abb10 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:40270/0 (socket says 172.21.15.57:40270) 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 -- 172.21.15.57:0/2038100352 learned_addr learned my addr 172.21.15.57:0/2038100352 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:56.731 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fa3ce700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f07f40b1190 0x7f07f4145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 -- 172.21.15.57:0/2038100352 >> v2:172.21.15.105:3300/0 conn(0x7f07f40b1190 msgr2=0x7f07f4145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 --2- 172.21.15.57:0/2038100352 >> v2:172.21.15.105:3300/0 conn(0x7f07f40b1190 0x7f07f4145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 -- 172.21.15.57:0/2038100352 >> v1:172.21.15.105:6789/0 conn(0x7f07f40ae400 legacy=0x7f07f40b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 -- 172.21.15.57:0/2038100352 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40ac970 con 0x7f07f40abb10 2023-10-06T03:53:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f93cc700 1 --2- 172.21.15.57:0/2038100352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009f20 tx=0x7f07ec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a83c726b900f389 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f8bcb700 1 -- 172.21.15.57:0/2038100352 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00e070 con 0x7f07f40abb10 2023-10-06T03:53:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f8bcb700 1 -- 172.21.15.57:0/2038100352 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec00b8d0 con 0x7f07f40abb10 2023-10-06T03:53:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07f8bcb700 1 -- 172.21.15.57:0/2038100352 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0092e0 con 0x7f07f40abb10 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- 172.21.15.57:0/2038100352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 msgr2=0x7f07f41459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 --2- 172.21.15.57:0/2038100352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009f20 tx=0x7f07ec009840 comp rx=0 tx=0).stop 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- 172.21.15.57:0/2038100352 shutdown_connections 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 --2- 172.21.15.57:0/2038100352 >> v2:172.21.15.105:3300/0 conn(0x7f07f40b1190 0x7f07f4145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 --2- 172.21.15.57:0/2038100352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40abb10 0x7f07f41459e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- 172.21.15.57:0/2038100352 >> 172.21.15.57:0/2038100352 conn(0x7f07f4067070 msgr2=0x7f07f4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- 172.21.15.57:0/2038100352 shutdown_connections 2023-10-06T03:53:56.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.727+0000 7f07fabcf700 1 -- 172.21.15.57:0/2038100352 wait complete. 2023-10-06T03:53:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 Processor -- start 2023-10-06T03:53:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- start start 2023-10-06T03:53:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07f40ae400 0x7f07f4140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40b1190 0x7f07f4140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4146920 con 0x7f07f40abb10 2023-10-06T03:53:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f413d110 con 0x7f07f40ae400 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40aaf40 con 0x7f07f40b1190 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46182/0 (socket says 172.21.15.57:46182) 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 -- 172.21.15.57:0/1299525465 learned_addr learned my addr 172.21.15.57:0/1299525465 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f93cc700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07f40ae400 0x7f07f4140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fa3ce700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40b1190 0x7f07f4140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 -- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40b1190 msgr2=0x7f07f4140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40b1190 0x7f07f4140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 -- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07f40ae400 msgr2=0x7f07f4140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07f40ae400 0x7f07f4140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 -- 172.21.15.57:0/1299525465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009ae0 con 0x7f07f40abb10 2023-10-06T03:53:56.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07f9bcd700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c810 tx=0x7f07e8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8011590 con 0x7f07f40abb10 2023-10-06T03:53:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8011710 con 0x7f07f40abb10 2023-10-06T03:53:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8011ad0 con 0x7f07f40abb10 2023-10-06T03:53:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f41466d0 con 0x7f07f40abb10 2023-10-06T03:53:56.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.731+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f413d5f0 con 0x7f07f40abb10 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f406b3a0 con 0x7f07f40abb10 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f07e801b3b0 con 0x7f07f40abb10 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07e5ffb700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 0x7f07d8062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07e807bf10 con 0x7f07f40abb10 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07f93cc700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 0x7f07d8062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.735+0000 7f07f93cc700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 0x7f07d8062ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009880 tx=0x7f07ec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:56.743 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.739+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f07e804c380 con 0x7f07f40abb10 2023-10-06T03:53:56.905 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.899+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07f40ac650 con 0x7f07f40abb10 2023-10-06T03:53:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.903+0000 7f07e5ffb700 1 -- 172.21.15.57:0/1299525465 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f07e8017070 con 0x7f07f40abb10 2023-10-06T03:53:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:56.907 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:53:45.646237+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 msgr2=0x7f07d8062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 0x7f07d8062ad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009880 tx=0x7f07ec017000 comp rx=0 tx=0).stop 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 msgr2=0x7f07f41478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f07e800c810 tx=0x7f07e8007f30 comp rx=0 tx=0).stop 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 shutdown_connections 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f07d8060620 0x7f07d8062ad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07f40b1190 0x7f07f4140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.910 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07f40ae400 0x7f07f4140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 --2- 172.21.15.57:0/1299525465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07f40abb10 0x7f07f41478e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:56.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 >> 172.21.15.57:0/1299525465 conn(0x7f07f4067070 msgr2=0x7f07f4067440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:56.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 shutdown_connections 2023-10-06T03:53:56.911 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:56.907+0000 7f07fabcf700 1 -- 172.21.15.57:0/1299525465 wait complete. 2023-10-06T03:53:56.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:53:57.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.023+0000 7f2f4b59e700 1 Processor -- start 2023-10-06T03:53:57.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.023+0000 7f2f4b59e700 1 -- start start 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f4c06c540 0x7f2f4c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c06ecd0 con 0x7f2f4c137d90 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c06efb0 con 0x7f2f4c0b1620 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c06dd30 con 0x7f2f4c06c540 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f4c06c540 0x7f2f4c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f4c06c540 0x7f2f4c06c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46192/0 (socket says 172.21.15.57:46192) 2023-10-06T03:53:57.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 -- 172.21.15.57:0/2496416188 learned_addr learned my addr 172.21.15.57:0/2496416188 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 -- 172.21.15.57:0/2496416188 >> v1:172.21.15.105:6789/0 conn(0x7f2f4c0b1620 legacy=0x7f2f4c142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 -- 172.21.15.57:0/2496416188 >> v1:172.21.15.57:6789/0 conn(0x7f2f4c137d90 legacy=0x7f2f4c138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 -- 172.21.15.57:0/2496416188 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c141c30 con 0x7f2f4c06c540 2023-10-06T03:53:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4a59c700 1 --2- 172.21.15.57:0/2496416188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c06c540 0x7f2f4c06c910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00bc40 tx=0x7f2f3c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaea20693669396 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f49d9b700 1 -- 172.21.15.57:0/2496416188 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00db40 con 0x7f2f4c06c540 2023-10-06T03:53:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f49d9b700 1 -- 172.21.15.57:0/2496416188 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00dca0 con 0x7f2f4c06c540 2023-10-06T03:53:57.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f49d9b700 1 -- 172.21.15.57:0/2496416188 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c017640 con 0x7f2f4c06c540 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 -- 172.21.15.57:0/2496416188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c06c540 msgr2=0x7f2f4c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.027+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/2496416188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c06c540 0x7f2f4c06c910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00bc40 tx=0x7f2f3c00b4e0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 -- 172.21.15.57:0/2496416188 shutdown_connections 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/2496416188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c06c540 0x7f2f4c06c910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 -- 172.21.15.57:0/2496416188 >> 172.21.15.57:0/2496416188 conn(0x7f2f4c0b1a00 msgr2=0x7f2f4c0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 -- 172.21.15.57:0/2496416188 shutdown_connections 2023-10-06T03:53:57.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 -- 172.21.15.57:0/2496416188 wait complete. 2023-10-06T03:53:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 Processor -- start 2023-10-06T03:53:57.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.031+0000 7f2f4b59e700 1 -- start start 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f4c06c540 0x7f2f4c140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4c13a080 0x7f2f4c152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1414d0 con 0x7f2f4c137d90 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0af1f0 con 0x7f2f4c06c540 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c13c010 con 0x7f2f4c13a080 2023-10-06T03:53:57.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46200/0 (socket says 172.21.15.57:46200) 2023-10-06T03:53:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 -- 172.21.15.57:0/1144618909 learned_addr learned my addr 172.21.15.57:0/1144618909 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4a59c700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f4c06c540 0x7f2f4c140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4ad9d700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4c13a080 0x7f2f4c152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 -- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4c13a080 msgr2=0x7f2f4c152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4c13a080 0x7f2f4c152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 -- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f4c06c540 msgr2=0x7f2f4c140f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f4c06c540 0x7f2f4c140f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 -- 172.21.15.57:0/1144618909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c00b780 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f41d9b700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c5c0 tx=0x7f2f34007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34011590 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34011710 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c13bca0 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34011ad0 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c13a5a0 con 0x7f2f4c137d90 2023-10-06T03:53:57.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.035+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c06b930 con 0x7f2f4c137d90 2023-10-06T03:53:57.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.039+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2f3401c440 con 0x7f2f4c137d90 2023-10-06T03:53:57.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.039+0000 7f2f42ffd700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 0x7f2f2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.039+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2f3407bbf0 con 0x7f2f4c137d90 2023-10-06T03:53:57.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.039+0000 7f2f4a59c700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 0x7f2f2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.043 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.039+0000 7f2f4a59c700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 0x7f2f2c062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b750 tx=0x7f2f3c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.047+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f3404c080 con 0x7f2f4c137d90 2023-10-06T03:53:57.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.251+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f4c04b5c0 con 0x7f2f4c137d90 2023-10-06T03:53:57.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.251+0000 7f2f42ffd700 1 -- 172.21.15.57:0/1144618909 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f2f34017020 con 0x7f2f4c137d90 2023-10-06T03:53:57.256 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:53:57.256 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 msgr2=0x7f2f2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 0x7f2f2c062a00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b750 tx=0x7f2f3c019000 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 msgr2=0x7f2f4c1523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c5c0 tx=0x7f2f34007f50 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 shutdown_connections 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f2f2c060550 0x7f2f2c062a00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4c13a080 0x7f2f4c152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f4c137d90 0x7f2f4c1523d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 --2- 172.21.15.57:0/1144618909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f4c06c540 0x7f2f4c140f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 >> 172.21.15.57:0/1144618909 conn(0x7f2f4c0b1a00 msgr2=0x7f2f4c062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 shutdown_connections 2023-10-06T03:53:57.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.255+0000 7f2f4b59e700 1 -- 172.21.15.57:0/1144618909 wait complete. 2023-10-06T03:53:57.260 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:53:57.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:53:44.000300+0000', 'modified': '2023-10-06T03:53:47.159976+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34133}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34133': {'gid': 34133, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2027616700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2027616700}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2027616700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:53:57.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:53:57.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:53:57.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 Processor -- start 2023-10-06T03:53:57.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 -- start start 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ecc13f7d0 0x7f3ecc14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc0b01b0 con 0x7f3ecc13f330 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ecc06d630 con 0x7f3ecc0701c0 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed1fd2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ecc06cf30 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3ecc13f330 0x7f3ecc14aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:34732/0 (socket says 172.21.15.57:34732) 2023-10-06T03:53:57.591 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecbfff700 1 -- 172.21.15.57:0/3444363748 learned_addr learned my addr 172.21.15.57:0/3444363748 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:53:57.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/3444363748 >> v2:172.21.15.105:3300/0 conn(0x7f3ecc13f7d0 0x7f3ecc14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecb7fe700 1 -- 172.21.15.57:0/3444363748 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165876498 0 0) 0x7f3ecc0b01b0 con 0x7f3ecc13f330 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecb7fe700 1 -- 172.21.15.57:0/3444363748 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb8003570 con 0x7f3ecc13f330 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed17d1700 1 -- 172.21.15.57:0/3444363748 >> v1:172.21.15.105:6789/0 conn(0x7f3ecc0701c0 legacy=0x7f3ecc06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed17d1700 1 -- 172.21.15.57:0/3444363748 >> v1:172.21.15.57:6789/0 conn(0x7f3ecc13f330 legacy=0x7f3ecc14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed17d1700 1 -- 172.21.15.57:0/3444363748 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc06d910 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/3444363748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc13f7d0 0x7f3ecc14e1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098e0 tx=0x7f3ebc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688e3e9b03291d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecb7fe700 1 -- 172.21.15.57:0/3444363748 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00b640 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecb7fe700 1 -- 172.21.15.57:0/3444363748 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00b7a0 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.587+0000 7f3ecb7fe700 1 -- 172.21.15.57:0/3444363748 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00bb40 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/3444363748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc13f7d0 msgr2=0x7f3ecc14e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/3444363748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc13f7d0 0x7f3ecc14e1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0098e0 tx=0x7f3ebc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/3444363748 shutdown_connections 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/3444363748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc13f7d0 0x7f3ecc14e1b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/3444363748 >> 172.21.15.57:0/3444363748 conn(0x7f3ecc0b1a60 msgr2=0x7f3ecc0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/3444363748 shutdown_connections 2023-10-06T03:53:57.594 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/3444363748 wait complete. 2023-10-06T03:53:57.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 Processor -- start 2023-10-06T03:53:57.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.591+0000 7f3ed1fd2700 1 -- start start 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0701c0 0x7f3ecc0b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc13f7d0 0x7f3ecc0ad610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc0ad1a0 con 0x7f3ecc13f330 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc152a60 con 0x7f3ecc0701c0 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ecc152d40 con 0x7f3ecc13f7d0 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46212/0 (socket says 172.21.15.57:46212) 2023-10-06T03:53:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 -- 172.21.15.57:0/66143147 learned_addr learned my addr 172.21.15.57:0/66143147 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc13f7d0 0x7f3ecc0ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0701c0 0x7f3ecc0b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 -- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc13f7d0 msgr2=0x7f3ecc0ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc13f7d0 0x7f3ecc0ad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 -- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0701c0 msgr2=0x7f3ecc0b4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0701c0 0x7f3ecc0b4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 -- 172.21.15.57:0/66143147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc009420 con 0x7f3ecc13f330 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cd30 tx=0x7f3ec4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ec8ff9700 1 -- 172.21.15.57:0/66143147 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400ce90 con 0x7f3ecc13f330 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ec8ff9700 1 -- 172.21.15.57:0/66143147 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec400aac0 con 0x7f3ecc13f330 2023-10-06T03:53:57.600 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc0a8970 con 0x7f3ecc13f330 2023-10-06T03:53:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ec8ff9700 1 -- 172.21.15.57:0/66143147 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400aea0 con 0x7f3ecc13f330 2023-10-06T03:53:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.595+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc1527d0 con 0x7f3ecc13f330 2023-10-06T03:53:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.599+0000 7f3ec8ff9700 1 -- 172.21.15.57:0/66143147 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3ec4007300 con 0x7f3ecc13f330 2023-10-06T03:53:57.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.599+0000 7f3ec8ff9700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 0x7f3eac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.599+0000 7f3ec8ff9700 1 -- 172.21.15.57:0/66143147 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ec407cce0 con 0x7f3ecc13f330 2023-10-06T03:53:57.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.599+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 0x7f3eac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 0x7f3eac062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4003a20 tx=0x7f3eb4007f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 Processor -- start 2023-10-06T03:53:57.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 -- start start 2023-10-06T03:53:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x12bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10a9790 0x12c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x1209f30 con 0x105e710 2023-10-06T03:53:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1205ed0 con 0x105eae0 2023-10-06T03:53:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x11cc0b0 con 0x10a9790 2023-10-06T03:53:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46220/0 (socket says 172.21.15.57:46220) 2023-10-06T03:53:57.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1856711554 learned_addr learned my addr 172.21.15.57:0/1856711554 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10a9790 0x12c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x12bdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10a9790 msgr2=0x12c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10a9790 0x12c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 msgr2=0x12bdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x12bdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.603+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1856711554 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10aa9e0 con 0x105e710 2023-10-06T03:53:57.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ec407b0a0 tx=0x7f3ec407b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41174c5ebcd1b82e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ec1ffb700 1 -- 172.21.15.57:0/1856711554 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4054140 con 0x105e710 2023-10-06T03:53:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ec1ffb700 1 -- 172.21.15.57:0/1856711554 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4057e90 con 0x105e710 2023-10-06T03:53:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ec1ffb700 1 -- 172.21.15.57:0/1856711554 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec404eff0 con 0x105e710 2023-10-06T03:53:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1856711554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 msgr2=0x1291f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3ec407b0a0 tx=0x7f3ec407b000 comp rx=0 tx=0).stop 2023-10-06T03:53:57.617 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1856711554 shutdown_connections 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x10a9790 0x12c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105e710 0x1291f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1856711554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x12bdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1856711554 >> 172.21.15.57:0/1856711554 conn(0x105eeb0 msgr2=0x12c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1856711554 shutdown_connections 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1856711554 wait complete. 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- start start 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 Processor -- start 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1296760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x1296ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x11cbd50 con 0x10a9790 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a4970 con 0x105eae0 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x1208590 con 0x105e710 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed54dd740 10 client.0 _ll_register_callbacks cb 0x11a8b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46226/0 (socket says 172.21.15.57:46226) 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 -- 172.21.15.57:0/917743494 learned_addr learned my addr 172.21.15.57:0/917743494 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1296760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x1296ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 -- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 msgr2=0x1296760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1296760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.619 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 -- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 msgr2=0x1296ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x1296ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 -- 172.21.15.57:0/917743494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ecc1527d0 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0b2af0 tx=0x7f3ebc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3303321761bb12d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.607+0000 7f3eaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc021070 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ebc01a800 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11a4cc0 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ebc01abd0 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 10 client.4704 fetch_fsmap learned FSMap version 7 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x11d4370 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11a4cc0 con 0x10a9790 2023-10-06T03:53:57.620 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f3ebc011c70 con 0x10a9790 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 10 client.4704 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 10 client.4704 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 20 client.4704 populate_metadata read hostname 'smithi057' 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x12d3720 0x12d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 4 client.4704 mds_command: new command op to 34133 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 --> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11a83e0 con 0x12d3720 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x12d3720 0x12d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 10 client.4704 ms_handle_connect on v2:172.21.15.105:6834/2027616700 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x12d3720 0x12d5b00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15d36d7c002471e2 server_cookie=55346d6c752784dc in_seq=0 out_seq=0 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 1 -- 172.21.15.57:0/917743494 <== mds.0 v2:172.21.15.105:6834/2027616700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x11a83e0 con 0x12d3720 2023-10-06T03:53:57.621 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3eaaffd700 10 client.4704 handle_command_reply: tid=0 2023-10-06T03:53:57.622 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 client.4704 shutdown 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 msgr2=0x12971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0b2af0 tx=0x7f3ebc017000 comp rx=0 tx=0).stop 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 shutdown_connections 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x12971e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x105eae0 0x1296ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.611+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x12d3720 0x12d5b00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/917743494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1296760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3eaaffd700 0 client.4704 ms_handle_reset on v2:172.21.15.105:6834/2027616700 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 >> 172.21.15.57:0/917743494 conn(0x105eeb0 msgr2=0x12c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 shutdown_connections 2023-10-06T03:53:57.623 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3ed54dd740 1 -- 172.21.15.57:0/917743494 wait complete. 2023-10-06T03:53:57.624 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.615+0000 7f3ed54dd740 20 client.4704 trim_cache size 0 max 16384 2023-10-06T03:53:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 Processor -- start 2023-10-06T03:53:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 -- start start 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x12d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10a9790 0x12d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x120aef0 con 0x105eae0 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d9f40 con 0x10a9790 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x11d9040 con 0x105e710 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46230/0 (socket says 172.21.15.57:46230) 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1976140914 learned_addr learned my addr 172.21.15.57:0/1976140914 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10a9790 0x12d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x12d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 msgr2=0x12d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x12d5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10a9790 msgr2=0x12d6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10a9790 0x12d6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.641 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1976140914 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0adeb0 con 0x105eae0 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4050bb0 tx=0x7f3ec401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6641ad5f2ab56b98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ec27fc700 1 -- 172.21.15.57:0/1976140914 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4050c80 con 0x105eae0 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ec27fc700 1 -- 172.21.15.57:0/1976140914 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4054140 con 0x105eae0 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ec27fc700 1 -- 172.21.15.57:0/1976140914 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4050eb0 con 0x105eae0 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1976140914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 msgr2=0x12d6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.635+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4050bb0 tx=0x7f3ec401c000 comp rx=0 tx=0).stop 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1976140914 shutdown_connections 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x10a9790 0x12d6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x105eae0 0x12d6040 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1976140914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x12d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1976140914 >> 172.21.15.57:0/1976140914 conn(0x105eeb0 msgr2=0x12bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1976140914 shutdown_connections 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1976140914 wait complete. 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- start start 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 Processor -- start 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1319bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x131aaa0 0x131ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x11da610 con 0x10a9790 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1204d60 con 0x131aaa0 2023-10-06T03:53:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x1203890 con 0x105e710 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 10 client.0 _ll_register_callbacks cb 0x120cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed0fd0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1319bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46234/0 (socket says 172.21.15.57:46234) 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1104980861 learned_addr learned my addr 172.21.15.57:0/1104980861 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:53:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed17d1700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x131aaa0 0x131ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 msgr2=0x1319bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1319bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x131aaa0 msgr2=0x131ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:53:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x131aaa0 0x131ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 -- 172.21.15.57:0/1104980861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10aa9e0 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ecbfff700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4050ac0 tx=0x7f3ec405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd00c314260f028d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40661d0 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ec407b0d0 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ec4057e90 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ec4066330 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 10 client.4710 fetch_fsmap learned FSMap version 7 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x11bad80 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4057e90 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) v1 ==== 2010+0+0 (secure 0 0 0) 0x7f3ec40753f0 con 0x10a9790 2023-10-06T03:53:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 10 client.4710 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 10 client.4710 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 20 client.4710 populate_metadata read hostname 'smithi057' 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x131b830 0x131bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 4 client.4710 mds_command: new command op to 34133 tid=0[{"prefix": "status"}] 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.639+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 --> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] -- command(tid 0: {"prefix": "status"}) v1 -- 0x11da410 con 0x131b830 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x131b830 0x131bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3eaaffd700 10 client.4710 ms_handle_connect on v2:172.21.15.105:6834/2027616700 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed0fd0700 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x131b830 0x131bc00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d670880f922aaf6e server_cookie=1d5616c0888774e3 in_seq=0 out_seq=0 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3eaaffd700 1 -- 172.21.15.57:0/1104980861 <== mds.0 v2:172.21.15.105:6834/2027616700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x11da410 con 0x131b830 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3eaaffd700 10 client.4710 handle_command_reply: tid=0 2023-10-06T03:53:57.650 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 client.4710 shutdown 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 msgr2=0x131a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4050ac0 tx=0x7f3ec405c000 comp rx=0 tx=0).stop 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 shutdown_connections 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x131aaa0 0x131ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x10a9790 0x131a0f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:6834/2027616700,v1:172.21.15.105:6835/2027616700] conn(0x131b830 0x131bc00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 --2- 172.21.15.57:0/1104980861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x105e710 0x1319bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3eaaffd700 0 client.4710 ms_handle_reset on v2:172.21.15.105:6834/2027616700 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 >> 172.21.15.57:0/1104980861 conn(0x105eeb0 msgr2=0x12d7150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 shutdown_connections 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 1 -- 172.21.15.57:0/1104980861 wait complete. 2023-10-06T03:53:57.651 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed54dd740 20 client.4710 trim_cache size 0 max 16384 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "366944c0-d2dc-4741-a456-286f74205a0c", 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 34133, 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2023-10-06T03:53:57.652 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 13.01309133, 2023-10-06T03:53:57.653 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 7, 2023-10-06T03:53:57.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 25, 2023-10-06T03:53:57.653 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 25, 2023-10-06T03:53:57.653 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 18.056082786000001 2023-10-06T03:53:57.653 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 msgr2=0x7f3eac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 0x7f3eac062a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4003a20 tx=0x7f3eb4007f10 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 msgr2=0x7f3ecc152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cd30 tx=0x7f3ec4001b10 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 shutdown_connections 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3eac060550 0x7f3eac062a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ecc13f7d0 0x7f3ecc0ad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ecc13f330 0x7f3ecc152070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 --2- 172.21.15.57:0/66143147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ecc0701c0 0x7f3ecc0b4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 >> 172.21.15.57:0/66143147 conn(0x7f3ecc0b1a60 msgr2=0x7f3ecc06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:53:57.654 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 shutdown_connections 2023-10-06T03:53:57.655 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:53:57.643+0000 7f3ed1fd2700 1 -- 172.21.15.57:0/66143147 wait complete. 2023-10-06T03:53:57.664 INFO:teuthology.run_tasks:Running task workunit... 2023-10-06T03:53:57.677 INFO:tasks.workunit:Pulling workunits from ref 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:53:57.678 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-06T03:53:57.678 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:53:57.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:53:57.686 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T03:53:57.686 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:53:57.693 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-06T03:53:57.693 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-06T03:53:57.697 INFO:tasks.workunit:timeout=3h 2023-10-06T03:53:57.698 INFO:tasks.workunit:cleanup=True 2023-10-06T03:53:57.698 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T03:53:57.709 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-06T03:54:02.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:54:02.979 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:54:33.023 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:54:33.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:54:43.613 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'. 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-06T03:54:43.614 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:43.615 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 68e53a4a7d4 Merge branch 'wip-ksirivad-quincy-backport-51923' of https://github.com/kamoltat/ceph into wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T03:54:43.618 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-06T03:54:43.648 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-06T03:54:43.666 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-06T03:54:43.666 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-06T03:54:44.517 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-06T03:54:44.596 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-06T03:54:44.666 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-06T03:54:44.668 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-06T03:54:44.668 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-06T03:54:44.735 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-06T03:54:44.748 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-10-06T03:54:44.749 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-06T03:54:44.756 INFO:tasks.workunit:Running workunits matching fs/test_python.sh on client.0... 2023-10-06T03:54:44.771 INFO:tasks.workunit:Running workunit fs/test_python.sh... 2023-10-06T03:54:44.772 DEBUG:teuthology.orchestra.run.smithi057:workunit test fs/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2023-10-06T03:54:44.784 INFO:tasks.workunit.client.0.smithi057.stderr:+ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2023-10-06T03:54:44.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ sudo python3 -m nose -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/../../../src/test/pybind/test_cephfs.py 2023-10-06T03:54:45.270 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.setup_test ... ok 2023-10-06T03:54:45.272 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_conf_get ... ok 2023-10-06T03:54:45.274 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_version ... ok 2023-10-06T03:54:45.282 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fstat ... ok 2023-10-06T03:54:45.288 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_statfs ... ok 2023-10-06T03:54:45.313 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_statx ... ok 2023-10-06T03:54:45.327 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_syncfs ... ok 2023-10-06T03:54:45.339 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fsync ... ok 2023-10-06T03:54:45.386 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_directory ... ok 2023-10-06T03:54:45.424 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_walk_dir ... ok 2023-10-06T03:54:45.450 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_xattr ... ok 2023-10-06T03:54:45.469 INFO:tasks.ceph.mds.b.smithi105.stderr:2023-10-06T03:54:45.465+0000 7f133da6b700 -1 mds.0.server mirror info parse error 2023-10-06T03:54:45.470 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_ceph_mirror_xattr ... ok 2023-10-06T03:54:45.492 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fxattr ... ok 2023-10-06T03:54:45.526 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_rename ... ok 2023-10-06T03:54:45.569 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_open ... ok 2023-10-06T03:54:45.584 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_link ... ok 2023-10-06T03:54:45.599 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_symlink ... ok 2023-10-06T03:54:45.621 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_readlink ... ok 2023-10-06T03:54:45.637 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_delete_cwd ... ok 2023-10-06T03:54:45.654 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_flock ... ok 2023-10-06T03:54:45.782 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_mount_unmount ... ok 2023-10-06T03:54:45.819 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_lxattr ... ok 2023-10-06T03:54:46.922 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_mount_root ... ok 2023-10-06T03:54:47.949 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_utime ... ok 2023-10-06T03:54:48.965 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_futime ... ok 2023-10-06T03:54:49.983 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_utimes ... ok 2023-10-06T03:54:51.025 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_lutimes ... ok 2023-10-06T03:54:52.042 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_futimes ... ok 2023-10-06T03:54:53.058 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_futimens ... ok 2023-10-06T03:54:54.090 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_lchmod ... ok 2023-10-06T03:54:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fchmod ... ok 2023-10-06T03:54:54.116 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fchown ... ok 2023-10-06T03:54:54.139 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_truncate ... ok 2023-10-06T03:54:54.165 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_ftruncate ... ok 2023-10-06T03:54:54.183 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fallocate ... ok 2023-10-06T03:54:54.195 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_mknod ... ok 2023-10-06T03:54:54.221 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_lazyio ... ok 2023-10-06T03:54:54.346 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_replication ... 2023-10-06T03:54:54.343+0000 7f7c52dad700 1 Processor -- start 2023-10-06T03:54:54.346 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 -- start start 2023-10-06T03:54:54.347 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c4c06eac0 0x7f7c4c06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c4c137f30 0x7f7c4c138350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c06e030 con 0x7f7c4c142160 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c141c80 con 0x7f7c4c137f30 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c52dad700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c06ce30 con 0x7f7c4c06eac0 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c4c137f30 0x7f7c4c138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c4c137f30 0x7f7c4c138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42958/0 (socket says 172.21.15.57:42958) 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c50b49700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c4c06eac0 0x7f7c4c06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.348 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 -- 172.21.15.57:0/2759816054 learned_addr learned my addr 172.21.15.57:0/2759816054 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:54.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 -- 172.21.15.57:0/2759816054 >> v2:172.21.15.105:3300/0 conn(0x7f7c4c06eac0 msgr2=0x7f7c4c06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:54.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 --2- 172.21.15.57:0/2759816054 >> v2:172.21.15.105:3300/0 conn(0x7f7c4c06eac0 0x7f7c4c06ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.349 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 -- 172.21.15.57:0/2759816054 >> v1:172.21.15.105:6789/0 conn(0x7f7c4c142160 legacy=0x7f7c4c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.343+0000 7f7c5134a700 1 -- 172.21.15.57:0/2759816054 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c06d110 con 0x7f7c4c137f30 2023-10-06T03:54:54.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c5134a700 1 --2- 172.21.15.57:0/2759816054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c137f30 0x7f7c4c138350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b60e0 tx=0x7f7c44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa504853703b7588 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:54.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c4b7fe700 1 -- 172.21.15.57:0/2759816054 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44009e70 con 0x7f7c4c137f30 2023-10-06T03:54:54.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c4b7fe700 1 -- 172.21.15.57:0/2759816054 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4400b860 con 0x7f7c4c137f30 2023-10-06T03:54:54.350 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c4b7fe700 1 -- 172.21.15.57:0/2759816054 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4400bc00 con 0x7f7c4c137f30 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 -- 172.21.15.57:0/2759816054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c137f30 msgr2=0x7f7c4c138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 --2- 172.21.15.57:0/2759816054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c137f30 0x7f7c4c138350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b60e0 tx=0x7f7c44009250 comp rx=0 tx=0).stop 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 -- 172.21.15.57:0/2759816054 shutdown_connections 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 --2- 172.21.15.57:0/2759816054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c137f30 0x7f7c4c138350 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 --2- 172.21.15.57:0/2759816054 >> v2:172.21.15.105:3300/0 conn(0x7f7c4c06eac0 0x7f7c4c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 -- 172.21.15.57:0/2759816054 >> 172.21.15.57:0/2759816054 conn(0x7f7c4c0b5130 msgr2=0x7f7c4c0b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 -- 172.21.15.57:0/2759816054 shutdown_connections 2023-10-06T03:54:54.351 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.347+0000 7f7c52dad700 1 -- 172.21.15.57:0/2759816054 wait complete. 2023-10-06T03:54:54.353 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 Processor -- start 2023-10-06T03:54:54.353 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 -- start start 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c4c06eac0 0x7f7c4c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c137f30 0x7f7c4c0ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0acb00 con 0x7f7c4c142160 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0af2a0 con 0x7f7c4c137f30 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0acf90 con 0x7f7c4c06eac0 2023-10-06T03:54:54.355 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42974/0 (socket says 172.21.15.57:42974) 2023-10-06T03:54:54.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 -- 172.21.15.57:0/794647723 learned_addr learned my addr 172.21.15.57:0/794647723 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:54.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c50b49700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c4c06eac0 0x7f7c4c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.356 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c4bfff700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c137f30 0x7f7c4c0ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 -- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c4c06eac0 msgr2=0x7f7c4c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c4c06eac0 0x7f7c4c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 -- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c137f30 msgr2=0x7f7c4c0ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c137f30 0x7f7c4c0ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 -- 172.21.15.57:0/794647723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440094f0 con 0x7f7c4c142160 2023-10-06T03:54:54.357 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c5134a700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009290 tx=0x7f7c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011420 con 0x7f7c4c142160 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c440115a0 con 0x7f7c4c142160 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c0ac4b0 con 0x7f7c4c142160 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.351+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011960 con 0x7f7c4c142160 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.355+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c0ae1d0 con 0x7f7c4c142160 2023-10-06T03:54:54.358 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.355+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c0acc70 con 0x7f7c4c142160 2023-10-06T03:54:54.359 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.355+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7c44011d10 con 0x7f7c4c142160 2023-10-06T03:54:54.360 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.355+0000 7f7c48ff9700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 0x7f7c2c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:54.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.359+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7c4407eb60 con 0x7f7c4c142160 2023-10-06T03:54:54.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.359+0000 7f7c50b49700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 0x7f7c2c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:54.361 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.359+0000 7f7c50b49700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 0x7f7c2c062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009fd0 tx=0x7f7c3c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:54.365 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.363+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7c44052a20 con 0x7f7c4c142160 2023-10-06T03:54:54.525 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size"} v 0) v1 -- 0x7f7c4c070d80 con 0x7f7c4c142160 2023-10-06T03:54:54.526 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c48ff9700 1 -- 172.21.15.57:0/794647723 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size"}]=0 v27) v1 ==== 98+0+8 (secure 0 0 0) 0x7f7c44033020 con 0x7f7c4c142160 2023-10-06T03:54:54.528 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 msgr2=0x7f7c2c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 0x7f7c2c062a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009fd0 tx=0x7f7c3c00b040 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 msgr2=0x7f7c4c14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009290 tx=0x7f7c44017000 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 shutdown_connections 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7c2c060550 0x7f7c2c062a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c4c142160 0x7f7c4c14e7f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c137f30 0x7f7c4c0ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 --2- 172.21.15.57:0/794647723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c4c06eac0 0x7f7c4c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.523+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 >> 172.21.15.57:0/794647723 conn(0x7f7c4c0b5130 msgr2=0x7f7c4c13df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:54.529 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.527+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 shutdown_connections 2023-10-06T03:54:54.530 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:54.527+0000 7f7c52dad700 1 -- 172.21.15.57:0/794647723 wait complete. 2023-10-06T03:54:54.544 INFO:tasks.workunit.client.0.smithi057.stderr:ok 2023-10-06T03:54:54.560 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_caps ... ok 2023-10-06T03:54:54.677 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_setuuid ... ok 2023-10-06T03:54:54.697 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_session_timeout ... ok 2023-10-06T03:54:54.721 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_readdirops ... ok 2023-10-06T03:54:54.726 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_preadv_pwritev ... ok 2023-10-06T03:54:55.755 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_setattrx ... ok 2023-10-06T03:54:56.781 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_fsetattrx ... ok 2023-10-06T03:54:56.795 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_get_layout ... ok 2023-10-06T03:54:56.804 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_get_default_pool ... ok 2023-10-06T03:54:56.916 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_get_pool ... 2023-10-06T03:54:56.911+0000 7f9566721700 1 Processor -- start 2023-10-06T03:54:56.916 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.911+0000 7f9566721700 1 -- start start 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95600b04b0 0x7f956006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9560139180 0x7f9560149850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956006d920 con 0x7f95600ac800 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9560139620 con 0x7f95600b04b0 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956006d5f0 con 0x7f9560139180 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95600b04b0 0x7f956006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.919 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95600b04b0 0x7f956006ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:58278/0 (socket says 172.21.15.57:58278) 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 -- 172.21.15.57:0/497601623 learned_addr learned my addr 172.21.15.57:0/497601623 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9564f1e700 1 --1- 172.21.15.57:0/497601623 >> v1:172.21.15.105:6789/0 conn(0x7f95600ac800 0x7f9560138a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:54890/0 (socket says 172.21.15.57:54890) 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9565f20700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9560139180 0x7f9560149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 -- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9560139180 msgr2=0x7f9560149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9560139180 0x7f9560149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 -- 172.21.15.57:0/497601623 >> v1:172.21.15.105:6789/0 conn(0x7f95600ac800 legacy=0x7f9560138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 -- 172.21.15.57:0/497601623 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956006e2f0 con 0x7f95600b04b0 2023-10-06T03:54:56.920 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f956571f700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95600b04b0 0x7f956006ddb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f955c0099b0 tx=0x7f955c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7439dd5b3533d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:56.921 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9557fff700 1 -- 172.21.15.57:0/497601623 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c009ea0 con 0x7f95600b04b0 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9557fff700 1 -- 172.21.15.57:0/497601623 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00b860 con 0x7f95600b04b0 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9557fff700 1 -- 172.21.15.57:0/497601623 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00bc20 con 0x7f95600b04b0 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95600b04b0 msgr2=0x7f956006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95600b04b0 0x7f956006ddb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f955c0099b0 tx=0x7f955c009250 comp rx=0 tx=0).stop 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- 172.21.15.57:0/497601623 shutdown_connections 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9560139180 0x7f9560149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 --2- 172.21.15.57:0/497601623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95600b04b0 0x7f956006ddb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.915+0000 7f9566721700 1 -- 172.21.15.57:0/497601623 >> 172.21.15.57:0/497601623 conn(0x7f9560068130 msgr2=0x7f9560068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:56.922 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- 172.21.15.57:0/497601623 shutdown_connections 2023-10-06T03:54:56.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- 172.21.15.57:0/497601623 wait complete. 2023-10-06T03:54:56.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 Processor -- start 2023-10-06T03:54:56.923 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- start start 2023-10-06T03:54:56.924 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 0x7f9560141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 0x7f956013b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956014fb00 con 0x7f95600ac800 2023-10-06T03:54:56.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560141940 con 0x7f9560139180 2023-10-06T03:54:56.925 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9566721700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9560150000 con 0x7f95600b04b0 2023-10-06T03:54:56.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f956571f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9564f1e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 0x7f9560141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f956571f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42988/0 (socket says 172.21.15.57:42988) 2023-10-06T03:54:56.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f9565f20700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 0x7f956013b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.926 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.919+0000 7f956571f700 1 -- 172.21.15.57:0/2347654788 learned_addr learned my addr 172.21.15.57:0/2347654788 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 -- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 msgr2=0x7f9560141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 0x7f9560141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 -- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 msgr2=0x7f956013b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 0x7f956013b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 -- 172.21.15.57:0/2347654788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0094f0 con 0x7f95600ac800 2023-10-06T03:54:56.928 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f9565f20700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 0x7f956013b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f9564f1e700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 0x7f9560141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f956571f700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95600b2c80 tx=0x7f955c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c01f070 con 0x7f95600ac800 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c006ab0 con 0x7f95600ac800 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956013a400 con 0x7f95600ac800 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00bc00 con 0x7f95600ac800 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956013ad30 con 0x7f95600ac800 2023-10-06T03:54:56.929 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.923+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956013af50 con 0x7f95600ac800 2023-10-06T03:54:56.930 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.927+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f955c011630 con 0x7f95600ac800 2023-10-06T03:54:56.930 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.927+0000 7f95557fa700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 0x7f9544062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:56.930 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.927+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f955c07dc00 con 0x7f95600ac800 2023-10-06T03:54:56.931 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.927+0000 7f9564f1e700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 0x7f9544062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:56.931 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.927+0000 7f9564f1e700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 0x7f9544062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f956013fe50 tx=0x7f9550007f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:56.939 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:56.935+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f955c084080 con 0x7f95600ac800 2023-10-06T03:54:57.104 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.099+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size"} v 0) v1 -- 0x7f9560071450 con 0x7f95600ac800 2023-10-06T03:54:57.105 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f95557fa700 1 -- 172.21.15.57:0/2347654788 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size"}]=0 v27) v1 ==== 98+0+8 (secure 0 0 0) 0x7f955c04e0d0 con 0x7f95600ac800 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 msgr2=0x7f9544062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 0x7f9544062a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f956013fe50 tx=0x7f9550007f40 comp rx=0 tx=0).stop 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 msgr2=0x7f956014f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95600b2c80 tx=0x7f955c017000 comp rx=0 tx=0).stop 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 shutdown_connections 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9544060550 0x7f9544062a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:57.110 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9560139180 0x7f956013b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:57.111 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95600b04b0 0x7f9560141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:57.111 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 --2- 172.21.15.57:0/2347654788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95600ac800 0x7f956014f5c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:57.111 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 >> 172.21.15.57:0/2347654788 conn(0x7f9560068130 msgr2=0x7f9560138840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:57.111 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 shutdown_connections 2023-10-06T03:54:57.111 INFO:tasks.workunit.client.0.smithi057.stderr:2023-10-06T03:54:57.103+0000 7f9566721700 1 -- 172.21.15.57:0/2347654788 wait complete. 2023-10-06T03:54:57.118 INFO:tasks.workunit.client.0.smithi057.stderr:ok 2023-10-06T03:54:57.137 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_disk_quota_exceeeded_error ... ok 2023-10-06T03:54:57.183 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_empty_snapshot_info ... ok 2023-10-06T03:54:57.229 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_snapshot_info ... ok 2023-10-06T03:54:57.237 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_set_mount_timeout_post_mount ... ok 2023-10-06T03:54:57.979 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_set_mount_timeout ... ok 2023-10-06T03:54:58.001 INFO:tasks.workunit.client.0.smithi057.stderr:test_cephfs.test_set_mount_timeout_lt0 ... ok 2023-10-06T03:54:58.001 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:58.001 INFO:tasks.workunit.client.0.smithi057.stderr:---------------------------------------------------------------------- 2023-10-06T03:54:58.002 INFO:tasks.workunit.client.0.smithi057.stderr:Ran 54 tests in 12.754s 2023-10-06T03:54:58.002 INFO:tasks.workunit.client.0.smithi057.stderr: 2023-10-06T03:54:58.002 INFO:tasks.workunit.client.0.smithi057.stderr:OK 2023-10-06T03:54:58.033 INFO:tasks.workunit.client.0.smithi057.stderr:+ exit 0 2023-10-06T03:54:58.034 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-06T03:54:58.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-06T03:54:58.092 INFO:tasks.workunit:Stopping ['fs/test_python.sh'] on client.0... 2023-10-06T03:54:58.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-06T03:54:58.318 DEBUG:teuthology.parallel:result is None 2023-10-06T03:54:58.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-06T03:54:58.334 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-06T03:54:58.335 DEBUG:teuthology.orchestra.run.smithi057:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:54:58.348 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-06T03:54:58.349 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:54:58.357 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:54:58.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:54:58.502 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 Processor -- start 2023-10-06T03:54:58.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 -- start start 2023-10-06T03:54:58.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3ec069490 0x7fe3ec145750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.503 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec142280 con 0x7fe3ec0b32a0 2023-10-06T03:54:58.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3ec13c990 con 0x7fe3ec069490 2023-10-06T03:54:58.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ebfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec143130 con 0x7fe3ec0b3670 2023-10-06T03:54:58.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3eb7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3ec069490 0x7fe3ec145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.504 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ea7fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ea7fc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:38528/0 (socket says 172.21.15.57:38528) 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3ea7fc700 1 -- 172.21.15.57:0/700313807 learned_addr learned my addr 172.21.15.57:0/700313807 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3eb7fe700 1 -- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 msgr2=0x7fe3ec068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3eb7fe700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3eb7fe700 1 -- 172.21.15.57:0/700313807 >> v1:172.21.15.105:6789/0 conn(0x7fe3ec0b32a0 legacy=0x7fe3ec142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.499+0000 7fe3eb7fe700 1 -- 172.21.15.57:0/700313807 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec142520 con 0x7fe3ec069490 2023-10-06T03:54:58.505 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ea7fc700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:54:58.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3eb7fe700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec069490 0x7fe3ec145750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009e60 tx=0x7fe3e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=935b4c18d0572cec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3e9ffb700 1 -- 172.21.15.57:0/700313807 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400e070 con 0x7fe3ec069490 2023-10-06T03:54:58.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3e9ffb700 1 -- 172.21.15.57:0/700313807 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e400bb60 con 0x7fe3ec069490 2023-10-06T03:54:58.506 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3e9ffb700 1 -- 172.21.15.57:0/700313807 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4012430 con 0x7fe3ec069490 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 -- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec069490 msgr2=0x7fe3ec145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec069490 0x7fe3ec145750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009e60 tx=0x7fe3e4009780 comp rx=0 tx=0).stop 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 -- 172.21.15.57:0/700313807 shutdown_connections 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec069490 0x7fe3ec145750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/700313807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.507 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 -- 172.21.15.57:0/700313807 >> 172.21.15.57:0/700313807 conn(0x7fe3ec067070 msgr2=0x7fe3ec067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:58.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 -- 172.21.15.57:0/700313807 shutdown_connections 2023-10-06T03:54:58.508 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.503+0000 7fe3ebfff700 1 -- 172.21.15.57:0/700313807 wait complete. 2023-10-06T03:54:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 Processor -- start 2023-10-06T03:54:58.509 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 -- start start 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec0b32a0 0x7fe3ec1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0af4f0 con 0x7fe3ec069490 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec1471d0 con 0x7fe3ec0b32a0 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ebfff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0ae6b0 con 0x7fe3ec0b3670 2023-10-06T03:54:58.512 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43038/0 (socket says 172.21.15.57:43038) 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 -- 172.21.15.57:0/568341589 learned_addr learned my addr 172.21.15.57:0/568341589 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3ea7fc700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec0b32a0 0x7fe3ec1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eb7fe700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 -- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 msgr2=0x7fe3ec146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 -- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec0b32a0 msgr2=0x7fe3ec1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec0b32a0 0x7fe3ec1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 -- 172.21.15.57:0/568341589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0094f0 con 0x7fe3ec069490 2023-10-06T03:54:58.513 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3eaffd700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c5c0 tx=0x7fe3d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.507+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4011590 con 0x7fe3ec069490 2023-10-06T03:54:58.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e4009a20 con 0x7fe3ec069490 2023-10-06T03:54:58.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4011710 con 0x7fe3ec069490 2023-10-06T03:54:58.514 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec13eb10 con 0x7fe3ec069490 2023-10-06T03:54:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4001120 con 0x7fe3ec069490 2023-10-06T03:54:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec0ae240 con 0x7fe3ec069490 2023-10-06T03:54:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe3d4011ca0 con 0x7fe3ec069490 2023-10-06T03:54:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3e2ffd700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 0x7fe3cc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.515 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe3d407bbb0 con 0x7fe3ec069490 2023-10-06T03:54:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.511+0000 7fe3ea7fc700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 0x7fe3cc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.516 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.515+0000 7fe3ea7fc700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 0x7fe3cc062a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec147890 tx=0x7fe3dc009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.521 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.519+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe3d404c0b0 con 0x7fe3ec069490 2023-10-06T03:54:58.685 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.683+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3ec0b7740 con 0x7fe3ec069490 2023-10-06T03:54:58.687 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.683+0000 7fe3e2ffd700 1 -- 172.21.15.57:0/568341589 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16961 (secure 0 0 0) 0x7fe3d4017020 con 0x7fe3ec069490 2023-10-06T03:54:58.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:54:58.687 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":27,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:54:26.303170+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:54:58.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 msgr2=0x7fe3cc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.689 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 0x7fe3cc062a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec147890 tx=0x7fe3dc009250 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 msgr2=0x7fe3ec13f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c5c0 tx=0x7fe3d400c8d0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 shutdown_connections 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe3cc060580 0x7fe3cc062a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3ec0b3670 0x7fe3ec146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3ec0b32a0 0x7fe3ec1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 --2- 172.21.15.57:0/568341589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3ec069490 0x7fe3ec13f030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 >> 172.21.15.57:0/568341589 conn(0x7fe3ec067070 msgr2=0x7fe3ec1451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 shutdown_connections 2023-10-06T03:54:58.690 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.687+0000 7fe3ebfff700 1 -- 172.21.15.57:0/568341589 wait complete. 2023-10-06T03:54:58.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:54:58.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:54:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 Processor -- start 2023-10-06T03:54:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 -- start start 2023-10-06T03:54:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f297806f3e0 0x7f2978146b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29780b39e0 con 0x7f29780b32a0 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2978147170 con 0x7f297813ff20 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ecfa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780b2ce0 con 0x7f297806f3e0 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297d4f7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f297806f3e0 0x7f2978146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297dcf8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29780b32a0 0x7f297814a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36230/0 (socket says 172.21.15.57:36230) 2023-10-06T03:54:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297dcf8700 1 -- 172.21.15.57:0/2297268400 learned_addr learned my addr 172.21.15.57:0/2297268400 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297d4f7700 1 -- 172.21.15.57:0/2297268400 >> v1:172.21.15.105:6789/0 conn(0x7f297813ff20 legacy=0x7f2978140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297ccf6700 1 -- 172.21.15.57:0/2297268400 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962449750 0 0) 0x7f29780b39e0 con 0x7f29780b32a0 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297d4f7700 1 -- 172.21.15.57:0/2297268400 >> v1:172.21.15.57:6789/0 conn(0x7f29780b32a0 legacy=0x7f297814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297d4f7700 1 -- 172.21.15.57:0/2297268400 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978147450 con 0x7f297806f3e0 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.803+0000 7f297d4f7700 1 --2- 172.21.15.57:0/2297268400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f297806f3e0 0x7f2978146b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29740098e0 tx=0x7f29740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b37bf6fe52887e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ccf6700 1 -- 172.21.15.57:0/2297268400 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974009e80 con 0x7f297806f3e0 2023-10-06T03:54:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ccf6700 1 -- 172.21.15.57:0/2297268400 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297400b860 con 0x7f297806f3e0 2023-10-06T03:54:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ccf6700 1 -- 172.21.15.57:0/2297268400 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400bbe0 con 0x7f297806f3e0 2023-10-06T03:54:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 -- 172.21.15.57:0/2297268400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f297806f3e0 msgr2=0x7f2978146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 --2- 172.21.15.57:0/2297268400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f297806f3e0 0x7f2978146b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f29740098e0 tx=0x7f29740091a0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 -- 172.21.15.57:0/2297268400 shutdown_connections 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 --2- 172.21.15.57:0/2297268400 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f297806f3e0 0x7f2978146b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 -- 172.21.15.57:0/2297268400 >> 172.21.15.57:0/2297268400 conn(0x7f2978067070 msgr2=0x7f2978067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 -- 172.21.15.57:0/2297268400 shutdown_connections 2023-10-06T03:54:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.807+0000 7f297ecfa700 1 -- 172.21.15.57:0/2297268400 wait complete. 2023-10-06T03:54:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 Processor -- start 2023-10-06T03:54:58.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- start start 2023-10-06T03:54:58.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f297806f3e0 0x7f2978141860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 0x7f29780ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2978143320 con 0x7f29780b32a0 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2978141da0 con 0x7f297813ff20 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2978140d90 con 0x7f297806f3e0 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43056/0 (socket says 172.21.15.57:43056) 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 -- 172.21.15.57:0/464691073 learned_addr learned my addr 172.21.15.57:0/464691073 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297dcf8700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f297806f3e0 0x7f2978141860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297e4f9700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 0x7f29780ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 -- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f297806f3e0 msgr2=0x7f2978141860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f297806f3e0 0x7f2978141860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 -- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 msgr2=0x7f29780ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 0x7f29780ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 -- 172.21.15.57:0/464691073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974009420 con 0x7f29780b32a0 2023-10-06T03:54:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297e4f9700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 0x7f29780ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:54:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297d4f7700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29780b79c0 tx=0x7f2974017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400bbe0 con 0x7f29780b32a0 2023-10-06T03:54:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974011420 con 0x7f29780b32a0 2023-10-06T03:54:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29780b0980 con 0x7f29780b32a0 2023-10-06T03:54:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740117c0 con 0x7f29780b32a0 2023-10-06T03:54:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.811+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978143590 con 0x7f29780b32a0 2023-10-06T03:54:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297806d540 con 0x7f29780b32a0 2023-10-06T03:54:58.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f2974011b30 con 0x7f29780b32a0 2023-10-06T03:54:58.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f2969ffb700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 0x7f295c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:58.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f297407e380 con 0x7f29780b32a0 2023-10-06T03:54:58.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f297dcf8700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 0x7f295c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.815+0000 7f297dcf8700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 0x7f295c062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f296c007fd0 tx=0x7f296c007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:58.827 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.823+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f297404e850 con 0x7f29780b32a0 2023-10-06T03:54:58.980 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.975+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29780b22f0 con 0x7f295c060550 2023-10-06T03:54:59.000 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:58.995+0000 7f2969ffb700 1 -- 172.21.15.57:0/464691073 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309366 (secure 0 0 0) 0x7f29780b22f0 con 0x7f295c060550 2023-10-06T03:54:59.004 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 msgr2=0x7f295c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 0x7f295c062a00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f296c007fd0 tx=0x7f296c007d10 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 msgr2=0x7f2978156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29780b79c0 tx=0x7f2974017000 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 shutdown_connections 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f295c060550 0x7f295c062a00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f297813ff20 0x7f29780ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29780b32a0 0x7f2978156120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 --2- 172.21.15.57:0/464691073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f297806f3e0 0x7f2978141860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 >> 172.21.15.57:0/464691073 conn(0x7f2978067070 msgr2=0x7f297806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 shutdown_connections 2023-10-06T03:54:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.003+0000 7f297ecfa700 1 -- 172.21.15.57:0/464691073 wait complete. 2023-10-06T03:54:59.008 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:54:59.023 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-06T03:54:58.652967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1003818,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":126,"num_read_kb":113,"num_write":368,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1860,"ondisk_log_size":1860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403060,"kb_used_data":4272,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571660,"statfs":{"total":773094113280,"available":770633379840,"internally_reserved":0,"allocated":4374528,"data_stored":2870452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196046,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":87,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006252"},"pg_stats":[{"pgid":"4.3f","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683577+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:54:54.683577+0000","last_peered":"2023-10-06T03:54:54.683577+0000","last_clean":"2023-10-06T03:54:54.683577+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:54:54.683577+0000","last_undegraded":"2023-10-06T03:54:54.683577+0000","last_fullsized":"2023-10-06T03:54:54.683577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'14","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685242+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:54:54.685242+0000","last_peered":"2023-10-06T03:54:54.685242+0000","last_clean":"2023-10-06T03:54:54.685242+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:54:54.685242+0000","last_undegraded":"2023-10-06T03:54:54.685242+0000","last_fullsized":"2023-10-06T03:54:54.685242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689931+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:54:54.689931+0000","last_peered":"2023-10-06T03:54:54.689931+0000","last_clean":"2023-10-06T03:54:54.689931+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:54:54.689931+0000","last_undegraded":"2023-10-06T03:54:54.689931+0000","last_fullsized":"2023-10-06T03:54:54.689931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682618+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:54:54.682618+0000","last_peered":"2023-10-06T03:54:54.682618+0000","last_clean":"2023-10-06T03:54:54.682618+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:54:54.682618+0000","last_undegraded":"2023-10-06T03:54:54.682618+0000","last_fullsized":"2023-10-06T03:54:54.682618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687151+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:54:54.687151+0000","last_peered":"2023-10-06T03:54:54.687151+0000","last_clean":"2023-10-06T03:54:54.687151+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:54:54.687151+0000","last_undegraded":"2023-10-06T03:54:54.687151+0000","last_fullsized":"2023-10-06T03:54:54.687151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683719+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:54:54.683719+0000","last_peered":"2023-10-06T03:54:54.683719+0000","last_clean":"2023-10-06T03:54:54.683719+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:54:54.683719+0000","last_undegraded":"2023-10-06T03:54:54.683719+0000","last_fullsized":"2023-10-06T03:54:54.683719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'16","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692180+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:54:54.692180+0000","last_peered":"2023-10-06T03:54:54.692180+0000","last_clean":"2023-10-06T03:54:54.692180+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:54:54.692180+0000","last_undegraded":"2023-10-06T03:54:54.692180+0000","last_fullsized":"2023-10-06T03:54:54.692180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687166+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:54:54.687166+0000","last_peered":"2023-10-06T03:54:54.687166+0000","last_clean":"2023-10-06T03:54:54.687166+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:54:54.687166+0000","last_undegraded":"2023-10-06T03:54:54.687166+0000","last_fullsized":"2023-10-06T03:54:54.687166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'28","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687577+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:54:54.687577+0000","last_peered":"2023-10-06T03:54:54.687577+0000","last_clean":"2023-10-06T03:54:54.687577+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:54:54.687577+0000","last_undegraded":"2023-10-06T03:54:54.687577+0000","last_fullsized":"2023-10-06T03:54:54.687577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'43","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684561+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:54:54.684561+0000","last_peered":"2023-10-06T03:54:54.684561+0000","last_clean":"2023-10-06T03:54:54.684561+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:54:54.684561+0000","last_undegraded":"2023-10-06T03:54:54.684561+0000","last_fullsized":"2023-10-06T03:54:54.684561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686050+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:54:54.686050+0000","last_peered":"2023-10-06T03:54:54.686050+0000","last_clean":"2023-10-06T03:54:54.686050+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:54:54.686050+0000","last_undegraded":"2023-10-06T03:54:54.686050+0000","last_fullsized":"2023-10-06T03:54:54.686050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688841+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:54:54.688841+0000","last_peered":"2023-10-06T03:54:54.688841+0000","last_clean":"2023-10-06T03:54:54.688841+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:54:54.688841+0000","last_undegraded":"2023-10-06T03:54:54.688841+0000","last_fullsized":"2023-10-06T03:54:54.688841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683658+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:54:54.683658+0000","last_peered":"2023-10-06T03:54:54.683658+0000","last_clean":"2023-10-06T03:54:54.683658+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:54:54.683658+0000","last_undegraded":"2023-10-06T03:54:54.683658+0000","last_fullsized":"2023-10-06T03:54:54.683658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674574+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:54:54.674574+0000","last_peered":"2023-10-06T03:54:54.674574+0000","last_clean":"2023-10-06T03:54:54.674574+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:54:54.674574+0000","last_undegraded":"2023-10-06T03:54:54.674574+0000","last_fullsized":"2023-10-06T03:54:54.674574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692613+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:54:54.692613+0000","last_peered":"2023-10-06T03:54:54.692613+0000","last_clean":"2023-10-06T03:54:54.692613+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:54:54.692613+0000","last_undegraded":"2023-10-06T03:54:54.692613+0000","last_fullsized":"2023-10-06T03:54:54.692613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691301+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:54:54.691301+0000","last_peered":"2023-10-06T03:54:54.691301+0000","last_clean":"2023-10-06T03:54:54.691301+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:54:54.691301+0000","last_undegraded":"2023-10-06T03:54:54.691301+0000","last_fullsized":"2023-10-06T03:54:54.691301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'24","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680941+0000","last_change":"2023-10-06T03:54:26.787211+0000","last_active":"2023-10-06T03:54:54.680941+0000","last_peered":"2023-10-06T03:54:54.680941+0000","last_clean":"2023-10-06T03:54:54.680941+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:54:54.680941+0000","last_undegraded":"2023-10-06T03:54:54.680941+0000","last_fullsized":"2023-10-06T03:54:54.680941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.190393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'39","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.701054+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:54:54.701054+0000","last_peered":"2023-10-06T03:54:54.701054+0000","last_clean":"2023-10-06T03:54:54.701054+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:54:54.701054+0000","last_undegraded":"2023-10-06T03:54:54.701054+0000","last_fullsized":"2023-10-06T03:54:54.701054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.676699+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:54:54.676699+0000","last_peered":"2023-10-06T03:54:54.676699+0000","last_clean":"2023-10-06T03:54:54.676699+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:54:54.676699+0000","last_undegraded":"2023-10-06T03:54:54.676699+0000","last_fullsized":"2023-10-06T03:54:54.676699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689949+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:54:54.689949+0000","last_peered":"2023-10-06T03:54:54.689949+0000","last_clean":"2023-10-06T03:54:54.689949+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:54:54.689949+0000","last_undegraded":"2023-10-06T03:54:54.689949+0000","last_fullsized":"2023-10-06T03:54:54.689949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'33","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680724+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:54:54.680724+0000","last_peered":"2023-10-06T03:54:54.680724+0000","last_clean":"2023-10-06T03:54:54.680724+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:54:54.680724+0000","last_undegraded":"2023-10-06T03:54:54.680724+0000","last_fullsized":"2023-10-06T03:54:54.680724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692819+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:54:54.692819+0000","last_peered":"2023-10-06T03:54:54.692819+0000","last_clean":"2023-10-06T03:54:54.692819+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:54:54.692819+0000","last_undegraded":"2023-10-06T03:54:54.692819+0000","last_fullsized":"2023-10-06T03:54:54.692819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684467+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:54:54.684467+0000","last_peered":"2023-10-06T03:54:54.684467+0000","last_clean":"2023-10-06T03:54:54.684467+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:54:54.684467+0000","last_undegraded":"2023-10-06T03:54:54.684467+0000","last_fullsized":"2023-10-06T03:54:54.684467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687655+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:54:54.687655+0000","last_peered":"2023-10-06T03:54:54.687655+0000","last_clean":"2023-10-06T03:54:54.687655+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:54:54.687655+0000","last_undegraded":"2023-10-06T03:54:54.687655+0000","last_fullsized":"2023-10-06T03:54:54.687655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.705056+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:54:54.705056+0000","last_peered":"2023-10-06T03:54:54.705056+0000","last_clean":"2023-10-06T03:54:54.705056+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:54:54.705056+0000","last_undegraded":"2023-10-06T03:54:54.705056+0000","last_fullsized":"2023-10-06T03:54:54.705056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686264+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:54:54.686264+0000","last_peered":"2023-10-06T03:54:54.686264+0000","last_clean":"2023-10-06T03:54:54.686264+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:54:54.686264+0000","last_undegraded":"2023-10-06T03:54:54.686264+0000","last_fullsized":"2023-10-06T03:54:54.686264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680747+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:54:54.680747+0000","last_peered":"2023-10-06T03:54:54.680747+0000","last_clean":"2023-10-06T03:54:54.680747+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:54:54.680747+0000","last_undegraded":"2023-10-06T03:54:54.680747+0000","last_fullsized":"2023-10-06T03:54:54.680747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685511+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:54:54.685511+0000","last_peered":"2023-10-06T03:54:54.685511+0000","last_clean":"2023-10-06T03:54:54.685511+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:54:54.685511+0000","last_undegraded":"2023-10-06T03:54:54.685511+0000","last_fullsized":"2023-10-06T03:54:54.685511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681986+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:54:54.681986+0000","last_peered":"2023-10-06T03:54:54.681986+0000","last_clean":"2023-10-06T03:54:54.681986+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:54:54.681986+0000","last_undegraded":"2023-10-06T03:54:54.681986+0000","last_fullsized":"2023-10-06T03:54:54.681986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682454+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:54:54.682454+0000","last_peered":"2023-10-06T03:54:54.682454+0000","last_clean":"2023-10-06T03:54:54.682454+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:54:54.682454+0000","last_undegraded":"2023-10-06T03:54:54.682454+0000","last_fullsized":"2023-10-06T03:54:54.682454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'31","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693858+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:54:54.693858+0000","last_peered":"2023-10-06T03:54:54.693858+0000","last_clean":"2023-10-06T03:54:54.693858+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:54:54.693858+0000","last_undegraded":"2023-10-06T03:54:54.693858+0000","last_fullsized":"2023-10-06T03:54:54.693858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.675641+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:54:54.675641+0000","last_peered":"2023-10-06T03:54:54.675641+0000","last_clean":"2023-10-06T03:54:54.675641+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:54:54.675641+0000","last_undegraded":"2023-10-06T03:54:54.675641+0000","last_fullsized":"2023-10-06T03:54:54.675641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'32","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693040+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:54:54.693040+0000","last_peered":"2023-10-06T03:54:54.693040+0000","last_clean":"2023-10-06T03:54:54.693040+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:54:54.693040+0000","last_undegraded":"2023-10-06T03:54:54.693040+0000","last_fullsized":"2023-10-06T03:54:54.693040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511750+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:54:27.511750+0000","last_peered":"2023-10-06T03:54:27.511750+0000","last_clean":"2023-10-06T03:54:27.511750+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:54:27.511750+0000","last_undegraded":"2023-10-06T03:54:27.511750+0000","last_fullsized":"2023-10-06T03:54:27.511750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680552+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:54:54.680552+0000","last_peered":"2023-10-06T03:54:54.680552+0000","last_clean":"2023-10-06T03:54:54.680552+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:54:54.680552+0000","last_undegraded":"2023-10-06T03:54:54.680552+0000","last_fullsized":"2023-10-06T03:54:54.680552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.319604+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:54:26.319604+0000","last_peered":"2023-10-06T03:54:26.319604+0000","last_clean":"2023-10-06T03:54:26.319604+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:54:26.319604+0000","last_undegraded":"2023-10-06T03:54:26.319604+0000","last_fullsized":"2023-10-06T03:54:26.319604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688175+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:54:54.688175+0000","last_peered":"2023-10-06T03:54:54.688175+0000","last_clean":"2023-10-06T03:54:54.688175+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:54:54.688175+0000","last_undegraded":"2023-10-06T03:54:54.688175+0000","last_fullsized":"2023-10-06T03:54:54.688175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442518+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:54:25.442518+0000","last_peered":"2023-10-06T03:54:25.442518+0000","last_clean":"2023-10-06T03:54:25.442518+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:54:25.442518+0000","last_undegraded":"2023-10-06T03:54:25.442518+0000","last_fullsized":"2023-10-06T03:54:25.442518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683628+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:54:54.683628+0000","last_peered":"2023-10-06T03:54:54.683628+0000","last_clean":"2023-10-06T03:54:54.683628+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:54:54.683628+0000","last_undegraded":"2023-10-06T03:54:54.683628+0000","last_fullsized":"2023-10-06T03:54:54.683628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511118+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:54:27.511118+0000","last_peered":"2023-10-06T03:54:27.511118+0000","last_clean":"2023-10-06T03:54:27.511118+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:54:27.511118+0000","last_undegraded":"2023-10-06T03:54:27.511118+0000","last_fullsized":"2023-10-06T03:54:27.511118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442576+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:54:25.442576+0000","last_peered":"2023-10-06T03:54:25.442576+0000","last_clean":"2023-10-06T03:54:25.442576+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:54:25.442576+0000","last_undegraded":"2023-10-06T03:54:25.442576+0000","last_fullsized":"2023-10-06T03:54:25.442576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681999+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:54:54.681999+0000","last_peered":"2023-10-06T03:54:54.681999+0000","last_clean":"2023-10-06T03:54:54.681999+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:54:54.681999+0000","last_undegraded":"2023-10-06T03:54:54.681999+0000","last_fullsized":"2023-10-06T03:54:54.681999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441963+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:54:25.441963+0000","last_peered":"2023-10-06T03:54:25.441963+0000","last_clean":"2023-10-06T03:54:25.441963+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:54:25.441963+0000","last_undegraded":"2023-10-06T03:54:25.441963+0000","last_fullsized":"2023-10-06T03:54:25.441963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'9","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.659454+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:54:54.659454+0000","last_peered":"2023-10-06T03:54:54.659454+0000","last_clean":"2023-10-06T03:54:54.659454+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:54:54.659454+0000","last_undegraded":"2023-10-06T03:54:54.659454+0000","last_fullsized":"2023-10-06T03:54:54.659454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442071+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:54:25.442071+0000","last_peered":"2023-10-06T03:54:25.442071+0000","last_clean":"2023-10-06T03:54:25.442071+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:54:25.442071+0000","last_undegraded":"2023-10-06T03:54:25.442071+0000","last_fullsized":"2023-10-06T03:54:25.442071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686059+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:54:54.686059+0000","last_peered":"2023-10-06T03:54:54.686059+0000","last_clean":"2023-10-06T03:54:54.686059+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:54:54.686059+0000","last_undegraded":"2023-10-06T03:54:54.686059+0000","last_fullsized":"2023-10-06T03:54:54.686059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322645+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:54:26.322645+0000","last_peered":"2023-10-06T03:54:26.322645+0000","last_clean":"2023-10-06T03:54:26.322645+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:54:26.322645+0000","last_undegraded":"2023-10-06T03:54:26.322645+0000","last_fullsized":"2023-10-06T03:54:26.322645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693248+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:54:54.693248+0000","last_peered":"2023-10-06T03:54:54.693248+0000","last_clean":"2023-10-06T03:54:54.693248+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:54:54.693248+0000","last_undegraded":"2023-10-06T03:54:54.693248+0000","last_fullsized":"2023-10-06T03:54:54.693248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318742+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:54:26.318742+0000","last_peered":"2023-10-06T03:54:26.318742+0000","last_clean":"2023-10-06T03:54:26.318742+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:54:26.318742+0000","last_undegraded":"2023-10-06T03:54:26.318742+0000","last_fullsized":"2023-10-06T03:54:26.318742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684017+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:54:54.684017+0000","last_peered":"2023-10-06T03:54:54.684017+0000","last_clean":"2023-10-06T03:54:54.684017+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:54:54.684017+0000","last_undegraded":"2023-10-06T03:54:54.684017+0000","last_fullsized":"2023-10-06T03:54:54.684017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511337+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:54:27.511337+0000","last_peered":"2023-10-06T03:54:27.511337+0000","last_clean":"2023-10-06T03:54:27.511337+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:54:27.511337+0000","last_undegraded":"2023-10-06T03:54:27.511337+0000","last_fullsized":"2023-10-06T03:54:27.511337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691133+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:54:54.691133+0000","last_peered":"2023-10-06T03:54:54.691133+0000","last_clean":"2023-10-06T03:54:54.691133+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:54:54.691133+0000","last_undegraded":"2023-10-06T03:54:54.691133+0000","last_fullsized":"2023-10-06T03:54:54.691133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307450+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:54:25.307450+0000","last_peered":"2023-10-06T03:54:25.307450+0000","last_clean":"2023-10-06T03:54:25.307450+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:54:25.307450+0000","last_undegraded":"2023-10-06T03:54:25.307450+0000","last_fullsized":"2023-10-06T03:54:25.307450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683144+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:54:54.683144+0000","last_peered":"2023-10-06T03:54:54.683144+0000","last_clean":"2023-10-06T03:54:54.683144+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:54:54.683144+0000","last_undegraded":"2023-10-06T03:54:54.683144+0000","last_fullsized":"2023-10-06T03:54:54.683144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318339+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:54:26.318339+0000","last_peered":"2023-10-06T03:54:26.318339+0000","last_clean":"2023-10-06T03:54:26.318339+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:54:26.318339+0000","last_undegraded":"2023-10-06T03:54:26.318339+0000","last_fullsized":"2023-10-06T03:54:26.318339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687775+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:54:54.687775+0000","last_peered":"2023-10-06T03:54:54.687775+0000","last_clean":"2023-10-06T03:54:54.687775+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:54:54.687775+0000","last_undegraded":"2023-10-06T03:54:54.687775+0000","last_fullsized":"2023-10-06T03:54:54.687775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441398+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:54:25.441398+0000","last_peered":"2023-10-06T03:54:25.441398+0000","last_clean":"2023-10-06T03:54:25.441398+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:54:25.441398+0000","last_undegraded":"2023-10-06T03:54:25.441398+0000","last_fullsized":"2023-10-06T03:54:25.441398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317159+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:54:25.317159+0000","last_peered":"2023-10-06T03:54:25.317159+0000","last_clean":"2023-10-06T03:54:25.317159+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:54:25.317159+0000","last_undegraded":"2023-10-06T03:54:25.317159+0000","last_fullsized":"2023-10-06T03:54:25.317159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.306186+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:54:25.306186+0000","last_peered":"2023-10-06T03:54:25.306186+0000","last_clean":"2023-10-06T03:54:25.306186+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:54:25.306186+0000","last_undegraded":"2023-10-06T03:54:25.306186+0000","last_fullsized":"2023-10-06T03:54:25.306186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683268+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:54:54.683268+0000","last_peered":"2023-10-06T03:54:54.683268+0000","last_clean":"2023-10-06T03:54:54.683268+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:54:54.683268+0000","last_undegraded":"2023-10-06T03:54:54.683268+0000","last_fullsized":"2023-10-06T03:54:54.683268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441157+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:54:25.441157+0000","last_peered":"2023-10-06T03:54:25.441157+0000","last_clean":"2023-10-06T03:54:25.441157+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:54:25.441157+0000","last_undegraded":"2023-10-06T03:54:25.441157+0000","last_fullsized":"2023-10-06T03:54:25.441157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.697685+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:54:54.697685+0000","last_peered":"2023-10-06T03:54:54.697685+0000","last_clean":"2023-10-06T03:54:54.697685+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:54:54.697685+0000","last_undegraded":"2023-10-06T03:54:54.697685+0000","last_fullsized":"2023-10-06T03:54:54.697685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693738+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:54:54.693738+0000","last_peered":"2023-10-06T03:54:54.693738+0000","last_clean":"2023-10-06T03:54:54.693738+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:54:54.693738+0000","last_undegraded":"2023-10-06T03:54:54.693738+0000","last_fullsized":"2023-10-06T03:54:54.693738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.314504+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:54:25.314504+0000","last_peered":"2023-10-06T03:54:25.314504+0000","last_clean":"2023-10-06T03:54:25.314504+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:54:25.314504+0000","last_undegraded":"2023-10-06T03:54:25.314504+0000","last_fullsized":"2023-10-06T03:54:25.314504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.163355+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:54:27.163355+0000","last_peered":"2023-10-06T03:54:27.163355+0000","last_clean":"2023-10-06T03:54:27.163355+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:54:27.163355+0000","last_undegraded":"2023-10-06T03:54:27.163355+0000","last_fullsized":"2023-10-06T03:54:27.163355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686184+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:54:54.686184+0000","last_peered":"2023-10-06T03:54:54.686184+0000","last_clean":"2023-10-06T03:54:54.686184+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:54:54.686184+0000","last_undegraded":"2023-10-06T03:54:54.686184+0000","last_fullsized":"2023-10-06T03:54:54.686184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317127+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:54:25.317127+0000","last_peered":"2023-10-06T03:54:25.317127+0000","last_clean":"2023-10-06T03:54:25.317127+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:54:25.317127+0000","last_undegraded":"2023-10-06T03:54:25.317127+0000","last_fullsized":"2023-10-06T03:54:25.317127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.308030+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:54:25.308030+0000","last_peered":"2023-10-06T03:54:25.308030+0000","last_clean":"2023-10-06T03:54:25.308030+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:54:25.308030+0000","last_undegraded":"2023-10-06T03:54:25.308030+0000","last_fullsized":"2023-10-06T03:54:25.308030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'26","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680025+0000","last_change":"2023-10-06T03:54:26.783934+0000","last_active":"2023-10-06T03:54:54.680025+0000","last_peered":"2023-10-06T03:54:54.680025+0000","last_clean":"2023-10-06T03:54:54.680025+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:54:54.680025+0000","last_undegraded":"2023-10-06T03:54:54.680025+0000","last_fullsized":"2023-10-06T03:54:54.680025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:52.067892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.318195+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:54:25.318195+0000","last_peered":"2023-10-06T03:54:25.318195+0000","last_clean":"2023-10-06T03:54:25.318195+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:54:25.318195+0000","last_undegraded":"2023-10-06T03:54:25.318195+0000","last_fullsized":"2023-10-06T03:54:25.318195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321701+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:54:25.321701+0000","last_peered":"2023-10-06T03:54:25.321701+0000","last_clean":"2023-10-06T03:54:25.321701+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:54:25.321701+0000","last_undegraded":"2023-10-06T03:54:25.321701+0000","last_fullsized":"2023-10-06T03:54:25.321701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685066+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:54:54.685066+0000","last_peered":"2023-10-06T03:54:54.685066+0000","last_clean":"2023-10-06T03:54:54.685066+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:54:54.685066+0000","last_undegraded":"2023-10-06T03:54:54.685066+0000","last_fullsized":"2023-10-06T03:54:54.685066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321605+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:54:25.321605+0000","last_peered":"2023-10-06T03:54:25.321605+0000","last_clean":"2023-10-06T03:54:25.321605+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:54:25.321605+0000","last_undegraded":"2023-10-06T03:54:25.321605+0000","last_fullsized":"2023-10-06T03:54:25.321605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442307+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:54:25.442307+0000","last_peered":"2023-10-06T03:54:25.442307+0000","last_clean":"2023-10-06T03:54:25.442307+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:54:25.442307+0000","last_undegraded":"2023-10-06T03:54:25.442307+0000","last_fullsized":"2023-10-06T03:54:25.442307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682160+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:54:54.682160+0000","last_peered":"2023-10-06T03:54:54.682160+0000","last_clean":"2023-10-06T03:54:54.682160+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:54:54.682160+0000","last_undegraded":"2023-10-06T03:54:54.682160+0000","last_fullsized":"2023-10-06T03:54:54.682160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318970+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:54:26.318970+0000","last_peered":"2023-10-06T03:54:26.318970+0000","last_clean":"2023-10-06T03:54:26.318970+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:54:26.318970+0000","last_undegraded":"2023-10-06T03:54:26.318970+0000","last_fullsized":"2023-10-06T03:54:26.318970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321818+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:54:25.321818+0000","last_peered":"2023-10-06T03:54:25.321818+0000","last_clean":"2023-10-06T03:54:25.321818+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:54:25.321818+0000","last_undegraded":"2023-10-06T03:54:25.321818+0000","last_fullsized":"2023-10-06T03:54:25.321818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682334+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:54:54.682334+0000","last_peered":"2023-10-06T03:54:54.682334+0000","last_clean":"2023-10-06T03:54:54.682334+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:54:54.682334+0000","last_undegraded":"2023-10-06T03:54:54.682334+0000","last_fullsized":"2023-10-06T03:54:54.682334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:49.597324+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:54:49.597324+0000","last_peered":"2023-10-06T03:54:49.597324+0000","last_clean":"2023-10-06T03:54:49.597324+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:54:49.597324+0000","last_undegraded":"2023-10-06T03:54:49.597324+0000","last_fullsized":"2023-10-06T03:54:49.597324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442543+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:54:25.442543+0000","last_peered":"2023-10-06T03:54:25.442543+0000","last_clean":"2023-10-06T03:54:25.442543+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:54:25.442543+0000","last_undegraded":"2023-10-06T03:54:25.442543+0000","last_fullsized":"2023-10-06T03:54:25.442543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.690041+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:54:54.690041+0000","last_peered":"2023-10-06T03:54:54.690041+0000","last_clean":"2023-10-06T03:54:54.690041+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:54:54.690041+0000","last_undegraded":"2023-10-06T03:54:54.690041+0000","last_fullsized":"2023-10-06T03:54:54.690041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'46","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691334+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:54:54.691334+0000","last_peered":"2023-10-06T03:54:54.691334+0000","last_clean":"2023-10-06T03:54:54.691334+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:54:54.691334+0000","last_undegraded":"2023-10-06T03:54:54.691334+0000","last_fullsized":"2023-10-06T03:54:54.691334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'104","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:55.747782+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:54:55.747782+0000","last_peered":"2023-10-06T03:54:55.747782+0000","last_clean":"2023-10-06T03:54:55.747782+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:54:55.747782+0000","last_undegraded":"2023-10-06T03:54:55.747782+0000","last_fullsized":"2023-10-06T03:54:55.747782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407920,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.677320+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:54:54.677320+0000","last_peered":"2023-10-06T03:54:54.677320+0000","last_clean":"2023-10-06T03:54:54.677320+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:54:54.677320+0000","last_undegraded":"2023-10-06T03:54:54.677320+0000","last_fullsized":"2023-10-06T03:54:54.677320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'11","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:53.707912+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:54:53.707912+0000","last_peered":"2023-10-06T03:54:53.707912+0000","last_clean":"2023-10-06T03:54:53.707912+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:54:53.707912+0000","last_undegraded":"2023-10-06T03:54:53.707912+0000","last_fullsized":"2023-10-06T03:54:53.707912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322868+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:54:26.322868+0000","last_peered":"2023-10-06T03:54:26.322868+0000","last_clean":"2023-10-06T03:54:26.322868+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:54:26.322868+0000","last_undegraded":"2023-10-06T03:54:26.322868+0000","last_fullsized":"2023-10-06T03:54:26.322868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682370+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:54:54.682370+0000","last_peered":"2023-10-06T03:54:54.682370+0000","last_clean":"2023-10-06T03:54:54.682370+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:54:54.682370+0000","last_undegraded":"2023-10-06T03:54:54.682370+0000","last_fullsized":"2023-10-06T03:54:54.682370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320410+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:54:26.320410+0000","last_peered":"2023-10-06T03:54:26.320410+0000","last_clean":"2023-10-06T03:54:26.320410+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:54:26.320410+0000","last_undegraded":"2023-10-06T03:54:26.320410+0000","last_fullsized":"2023-10-06T03:54:26.320410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692340+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:54:54.692340+0000","last_peered":"2023-10-06T03:54:54.692340+0000","last_clean":"2023-10-06T03:54:54.692340+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:54:54.692340+0000","last_undegraded":"2023-10-06T03:54:54.692340+0000","last_fullsized":"2023-10-06T03:54:54.692340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674969+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:54:54.674969+0000","last_peered":"2023-10-06T03:54:54.674969+0000","last_clean":"2023-10-06T03:54:54.674969+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:54:54.674969+0000","last_undegraded":"2023-10-06T03:54:54.674969+0000","last_fullsized":"2023-10-06T03:54:54.674969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.305861+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:54:25.305861+0000","last_peered":"2023-10-06T03:54:25.305861+0000","last_clean":"2023-10-06T03:54:25.305861+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:54:25.305861+0000","last_undegraded":"2023-10-06T03:54:25.305861+0000","last_fullsized":"2023-10-06T03:54:25.305861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683307+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:54:54.683307+0000","last_peered":"2023-10-06T03:54:54.683307+0000","last_clean":"2023-10-06T03:54:54.683307+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:54:54.683307+0000","last_undegraded":"2023-10-06T03:54:54.683307+0000","last_fullsized":"2023-10-06T03:54:54.683307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.702690+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:54:46.702690+0000","last_peered":"2023-10-06T03:54:46.702690+0000","last_clean":"2023-10-06T03:54:46.702690+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:54:46.702690+0000","last_undegraded":"2023-10-06T03:54:46.702690+0000","last_fullsized":"2023-10-06T03:54:46.702690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693364+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:54:54.693364+0000","last_peered":"2023-10-06T03:54:54.693364+0000","last_clean":"2023-10-06T03:54:54.693364+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:54:54.693364+0000","last_undegraded":"2023-10-06T03:54:54.693364+0000","last_fullsized":"2023-10-06T03:54:54.693364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307756+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:54:25.307756+0000","last_peered":"2023-10-06T03:54:25.307756+0000","last_clean":"2023-10-06T03:54:25.307756+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:54:25.307756+0000","last_undegraded":"2023-10-06T03:54:25.307756+0000","last_fullsized":"2023-10-06T03:54:25.307756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692904+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:54:54.692904+0000","last_peered":"2023-10-06T03:54:54.692904+0000","last_clean":"2023-10-06T03:54:54.692904+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:54:54.692904+0000","last_undegraded":"2023-10-06T03:54:54.692904+0000","last_fullsized":"2023-10-06T03:54:54.692904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320056+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:54:26.320056+0000","last_peered":"2023-10-06T03:54:26.320056+0000","last_clean":"2023-10-06T03:54:26.320056+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:54:26.320056+0000","last_undegraded":"2023-10-06T03:54:26.320056+0000","last_fullsized":"2023-10-06T03:54:26.320056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686775+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:54:54.686775+0000","last_peered":"2023-10-06T03:54:54.686775+0000","last_clean":"2023-10-06T03:54:54.686775+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:54:54.686775+0000","last_undegraded":"2023-10-06T03:54:54.686775+0000","last_fullsized":"2023-10-06T03:54:54.686775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317777+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:54:25.317777+0000","last_peered":"2023-10-06T03:54:25.317777+0000","last_clean":"2023-10-06T03:54:25.317777+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:54:25.317777+0000","last_undegraded":"2023-10-06T03:54:25.317777+0000","last_fullsized":"2023-10-06T03:54:25.317777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691238+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:54:54.691238+0000","last_peered":"2023-10-06T03:54:54.691238+0000","last_clean":"2023-10-06T03:54:54.691238+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:54:54.691238+0000","last_undegraded":"2023-10-06T03:54:54.691238+0000","last_fullsized":"2023-10-06T03:54:54.691238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322849+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:54:26.322849+0000","last_peered":"2023-10-06T03:54:26.322849+0000","last_clean":"2023-10-06T03:54:26.322849+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:54:26.322849+0000","last_undegraded":"2023-10-06T03:54:26.322849+0000","last_fullsized":"2023-10-06T03:54:26.322849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687161+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:54:54.687161+0000","last_peered":"2023-10-06T03:54:54.687161+0000","last_clean":"2023-10-06T03:54:54.687161+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:54:54.687161+0000","last_undegraded":"2023-10-06T03:54:54.687161+0000","last_fullsized":"2023-10-06T03:54:54.687161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318654+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:54:26.318654+0000","last_peered":"2023-10-06T03:54:26.318654+0000","last_clean":"2023-10-06T03:54:26.318654+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:54:26.318654+0000","last_undegraded":"2023-10-06T03:54:26.318654+0000","last_fullsized":"2023-10-06T03:54:26.318654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683856+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:54:54.683856+0000","last_peered":"2023-10-06T03:54:54.683856+0000","last_clean":"2023-10-06T03:54:54.683856+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:54:54.683856+0000","last_undegraded":"2023-10-06T03:54:54.683856+0000","last_fullsized":"2023-10-06T03:54:54.683856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320336+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:54:26.320336+0000","last_peered":"2023-10-06T03:54:26.320336+0000","last_clean":"2023-10-06T03:54:26.320336+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:54:26.320336+0000","last_undegraded":"2023-10-06T03:54:26.320336+0000","last_fullsized":"2023-10-06T03:54:26.320336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":413437,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":165,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":892928,"data_stored":826874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":1100059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.046},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.139}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.244}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.419},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0740000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":109960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.141}]},{"osd":1,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.746},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1659999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.107}]},{"osd":7,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.085},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.0589999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.044}]},{"osd":1,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.999}]},{"osd":2,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.135}]},{"osd":4,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.161},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.206}]},{"osd":7,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.177}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":720896,"data_stored":514291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.288}]},{"osd":5,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.871},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.026}]},{"osd":6,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.131},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.4770000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.432},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.94799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.151},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747}]},{"osd":1,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.321},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.002}]},{"osd":6,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.177},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.397}]},{"osd":7,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.29},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.246}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301668,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3280000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.997}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.091}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4419999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":892928,"data_stored":705620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.113},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.5149999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.93999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":5301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":412723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":408136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:54:59.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.135+0000 7f3072264700 1 Processor -- start 2023-10-06T03:54:59.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.135+0000 7f3072264700 1 -- start start 2023-10-06T03:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f306c1464c0 0x7f306c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0b20e0 con 0x7f306c0b0950 2023-10-06T03:54:59.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306c0ac360 con 0x7f306c142340 2023-10-06T03:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306c1459e0 con 0x7f306c1464c0 2023-10-06T03:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3071262700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f306c0b0950 0x7f306c0b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36236/0 (socket says 172.21.15.57:36236) 2023-10-06T03:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3071262700 1 -- 172.21.15.57:0/68700316 learned_addr learned my addr 172.21.15.57:0/68700316 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:54:59.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3070a61700 1 --2- 172.21.15.57:0/68700316 >> v2:172.21.15.105:3300/0 conn(0x7f306c1464c0 0x7f306c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3063fff700 1 -- 172.21.15.57:0/68700316 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716832493 0 0) 0x7f306c0b20e0 con 0x7f306c0b0950 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3063fff700 1 -- 172.21.15.57:0/68700316 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003570 con 0x7f306c0b0950 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3070a61700 1 -- 172.21.15.57:0/68700316 >> v1:172.21.15.105:6789/0 conn(0x7f306c142340 legacy=0x7f306c1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3070a61700 1 -- 172.21.15.57:0/68700316 >> v1:172.21.15.57:6789/0 conn(0x7f306c0b0950 legacy=0x7f306c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3070a61700 1 -- 172.21.15.57:0/68700316 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c145cc0 con 0x7f306c1464c0 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3070a61700 1 --2- 172.21.15.57:0/68700316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c0b0d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30680098e0 tx=0x7f30680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e18ba8c3a9ce72c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3063fff700 1 -- 172.21.15.57:0/68700316 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800b640 con 0x7f306c1464c0 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3063fff700 1 -- 172.21.15.57:0/68700316 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800b7a0 con 0x7f306c1464c0 2023-10-06T03:54:59.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3063fff700 1 -- 172.21.15.57:0/68700316 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800bb40 con 0x7f306c1464c0 2023-10-06T03:54:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- 172.21.15.57:0/68700316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 msgr2=0x7f306c0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 --2- 172.21.15.57:0/68700316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c0b0d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f30680098e0 tx=0x7f30680091a0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- 172.21.15.57:0/68700316 shutdown_connections 2023-10-06T03:54:59.145 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 --2- 172.21.15.57:0/68700316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c0b0d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- 172.21.15.57:0/68700316 >> 172.21.15.57:0/68700316 conn(0x7f306c068f20 msgr2=0x7f306c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- 172.21.15.57:0/68700316 shutdown_connections 2023-10-06T03:54:59.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.139+0000 7f3072264700 1 -- 172.21.15.57:0/68700316 wait complete. 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 Processor -- start 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- start start 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f306c0b0950 0x7f306c144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c1449c0 con 0x7f306c142340 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13cca0 con 0x7f306c1464c0 2023-10-06T03:54:59.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306c13d260 con 0x7f306c0b0950 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43068/0 (socket says 172.21.15.57:43068) 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 -- 172.21.15.57:0/1921718591 learned_addr learned my addr 172.21.15.57:0/1921718591 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3071262700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f306c0b0950 0x7f306c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3071a63700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 -- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f306c0b0950 msgr2=0x7f306c144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f306c0b0950 0x7f306c144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 -- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 msgr2=0x7f306c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 -- 172.21.15.57:0/1921718591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009420 con 0x7f306c142340 2023-10-06T03:54:59.151 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3070a61700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f306c1469b0 tx=0x7f3068017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068000d10 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800bb20 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306c13dc30 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068011650 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.143+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306c13cef0 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306c06a300 con 0x7f306c142340 2023-10-06T03:54:59.152 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f30680119c0 con 0x7f306c142340 2023-10-06T03:54:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f30617fa700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 0x7f3050062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f306807dc30 con 0x7f306c142340 2023-10-06T03:54:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f3071262700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 0x7f3050062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.153 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.147+0000 7f3071262700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 0x7f3050062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f305c007fd0 tx=0x7f305c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.159+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f306804e100 con 0x7f306c142340 2023-10-06T03:54:59.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.315+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f306c145fa0 con 0x7f3050060550 2023-10-06T03:54:59.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.331+0000 7f30617fa700 1 -- 172.21.15.57:0/1921718591 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309366 (secure 0 0 0) 0x7f306c145fa0 con 0x7f3050060550 2023-10-06T03:54:59.340 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 msgr2=0x7f3050062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 0x7f3050062a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f305c007fd0 tx=0x7f305c009040 comp rx=0 tx=0).stop 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 msgr2=0x7f306c13d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f306c1469b0 tx=0x7f3068017000 comp rx=0 tx=0).stop 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 shutdown_connections 2023-10-06T03:54:59.343 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3050060550 0x7f3050062a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f306c1464c0 0x7f306c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f306c142340 0x7f306c13d6f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 --2- 172.21.15.57:0/1921718591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f306c0b0950 0x7f306c144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 >> 172.21.15.57:0/1921718591 conn(0x7f306c068f20 msgr2=0x7f306c1427a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 shutdown_connections 2023-10-06T03:54:59.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.339+0000 7f3072264700 1 -- 172.21.15.57:0/1921718591 wait complete. 2023-10-06T03:54:59.345 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:54:59.356 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-06T03:54:58.652967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1003818,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":126,"num_read_kb":113,"num_write":368,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1860,"ondisk_log_size":1860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403060,"kb_used_data":4272,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571660,"statfs":{"total":773094113280,"available":770633379840,"internally_reserved":0,"allocated":4374528,"data_stored":2870452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196046,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":87,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006252"},"pg_stats":[{"pgid":"4.3f","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683577+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:54:54.683577+0000","last_peered":"2023-10-06T03:54:54.683577+0000","last_clean":"2023-10-06T03:54:54.683577+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:54:54.683577+0000","last_undegraded":"2023-10-06T03:54:54.683577+0000","last_fullsized":"2023-10-06T03:54:54.683577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'14","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685242+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:54:54.685242+0000","last_peered":"2023-10-06T03:54:54.685242+0000","last_clean":"2023-10-06T03:54:54.685242+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:54:54.685242+0000","last_undegraded":"2023-10-06T03:54:54.685242+0000","last_fullsized":"2023-10-06T03:54:54.685242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689931+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:54:54.689931+0000","last_peered":"2023-10-06T03:54:54.689931+0000","last_clean":"2023-10-06T03:54:54.689931+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:54:54.689931+0000","last_undegraded":"2023-10-06T03:54:54.689931+0000","last_fullsized":"2023-10-06T03:54:54.689931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682618+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:54:54.682618+0000","last_peered":"2023-10-06T03:54:54.682618+0000","last_clean":"2023-10-06T03:54:54.682618+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:54:54.682618+0000","last_undegraded":"2023-10-06T03:54:54.682618+0000","last_fullsized":"2023-10-06T03:54:54.682618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687151+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:54:54.687151+0000","last_peered":"2023-10-06T03:54:54.687151+0000","last_clean":"2023-10-06T03:54:54.687151+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:54:54.687151+0000","last_undegraded":"2023-10-06T03:54:54.687151+0000","last_fullsized":"2023-10-06T03:54:54.687151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683719+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:54:54.683719+0000","last_peered":"2023-10-06T03:54:54.683719+0000","last_clean":"2023-10-06T03:54:54.683719+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:54:54.683719+0000","last_undegraded":"2023-10-06T03:54:54.683719+0000","last_fullsized":"2023-10-06T03:54:54.683719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'16","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692180+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:54:54.692180+0000","last_peered":"2023-10-06T03:54:54.692180+0000","last_clean":"2023-10-06T03:54:54.692180+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:54:54.692180+0000","last_undegraded":"2023-10-06T03:54:54.692180+0000","last_fullsized":"2023-10-06T03:54:54.692180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687166+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:54:54.687166+0000","last_peered":"2023-10-06T03:54:54.687166+0000","last_clean":"2023-10-06T03:54:54.687166+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:54:54.687166+0000","last_undegraded":"2023-10-06T03:54:54.687166+0000","last_fullsized":"2023-10-06T03:54:54.687166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'28","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687577+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:54:54.687577+0000","last_peered":"2023-10-06T03:54:54.687577+0000","last_clean":"2023-10-06T03:54:54.687577+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:54:54.687577+0000","last_undegraded":"2023-10-06T03:54:54.687577+0000","last_fullsized":"2023-10-06T03:54:54.687577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'43","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684561+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:54:54.684561+0000","last_peered":"2023-10-06T03:54:54.684561+0000","last_clean":"2023-10-06T03:54:54.684561+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:54:54.684561+0000","last_undegraded":"2023-10-06T03:54:54.684561+0000","last_fullsized":"2023-10-06T03:54:54.684561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686050+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:54:54.686050+0000","last_peered":"2023-10-06T03:54:54.686050+0000","last_clean":"2023-10-06T03:54:54.686050+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:54:54.686050+0000","last_undegraded":"2023-10-06T03:54:54.686050+0000","last_fullsized":"2023-10-06T03:54:54.686050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688841+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:54:54.688841+0000","last_peered":"2023-10-06T03:54:54.688841+0000","last_clean":"2023-10-06T03:54:54.688841+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:54:54.688841+0000","last_undegraded":"2023-10-06T03:54:54.688841+0000","last_fullsized":"2023-10-06T03:54:54.688841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683658+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:54:54.683658+0000","last_peered":"2023-10-06T03:54:54.683658+0000","last_clean":"2023-10-06T03:54:54.683658+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:54:54.683658+0000","last_undegraded":"2023-10-06T03:54:54.683658+0000","last_fullsized":"2023-10-06T03:54:54.683658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674574+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:54:54.674574+0000","last_peered":"2023-10-06T03:54:54.674574+0000","last_clean":"2023-10-06T03:54:54.674574+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:54:54.674574+0000","last_undegraded":"2023-10-06T03:54:54.674574+0000","last_fullsized":"2023-10-06T03:54:54.674574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692613+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:54:54.692613+0000","last_peered":"2023-10-06T03:54:54.692613+0000","last_clean":"2023-10-06T03:54:54.692613+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:54:54.692613+0000","last_undegraded":"2023-10-06T03:54:54.692613+0000","last_fullsized":"2023-10-06T03:54:54.692613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691301+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:54:54.691301+0000","last_peered":"2023-10-06T03:54:54.691301+0000","last_clean":"2023-10-06T03:54:54.691301+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:54:54.691301+0000","last_undegraded":"2023-10-06T03:54:54.691301+0000","last_fullsized":"2023-10-06T03:54:54.691301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'24","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680941+0000","last_change":"2023-10-06T03:54:26.787211+0000","last_active":"2023-10-06T03:54:54.680941+0000","last_peered":"2023-10-06T03:54:54.680941+0000","last_clean":"2023-10-06T03:54:54.680941+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:54:54.680941+0000","last_undegraded":"2023-10-06T03:54:54.680941+0000","last_fullsized":"2023-10-06T03:54:54.680941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.190393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'39","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.701054+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:54:54.701054+0000","last_peered":"2023-10-06T03:54:54.701054+0000","last_clean":"2023-10-06T03:54:54.701054+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:54:54.701054+0000","last_undegraded":"2023-10-06T03:54:54.701054+0000","last_fullsized":"2023-10-06T03:54:54.701054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.676699+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:54:54.676699+0000","last_peered":"2023-10-06T03:54:54.676699+0000","last_clean":"2023-10-06T03:54:54.676699+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:54:54.676699+0000","last_undegraded":"2023-10-06T03:54:54.676699+0000","last_fullsized":"2023-10-06T03:54:54.676699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689949+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:54:54.689949+0000","last_peered":"2023-10-06T03:54:54.689949+0000","last_clean":"2023-10-06T03:54:54.689949+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:54:54.689949+0000","last_undegraded":"2023-10-06T03:54:54.689949+0000","last_fullsized":"2023-10-06T03:54:54.689949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'33","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680724+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:54:54.680724+0000","last_peered":"2023-10-06T03:54:54.680724+0000","last_clean":"2023-10-06T03:54:54.680724+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:54:54.680724+0000","last_undegraded":"2023-10-06T03:54:54.680724+0000","last_fullsized":"2023-10-06T03:54:54.680724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692819+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:54:54.692819+0000","last_peered":"2023-10-06T03:54:54.692819+0000","last_clean":"2023-10-06T03:54:54.692819+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:54:54.692819+0000","last_undegraded":"2023-10-06T03:54:54.692819+0000","last_fullsized":"2023-10-06T03:54:54.692819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684467+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:54:54.684467+0000","last_peered":"2023-10-06T03:54:54.684467+0000","last_clean":"2023-10-06T03:54:54.684467+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:54:54.684467+0000","last_undegraded":"2023-10-06T03:54:54.684467+0000","last_fullsized":"2023-10-06T03:54:54.684467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687655+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:54:54.687655+0000","last_peered":"2023-10-06T03:54:54.687655+0000","last_clean":"2023-10-06T03:54:54.687655+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:54:54.687655+0000","last_undegraded":"2023-10-06T03:54:54.687655+0000","last_fullsized":"2023-10-06T03:54:54.687655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.705056+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:54:54.705056+0000","last_peered":"2023-10-06T03:54:54.705056+0000","last_clean":"2023-10-06T03:54:54.705056+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:54:54.705056+0000","last_undegraded":"2023-10-06T03:54:54.705056+0000","last_fullsized":"2023-10-06T03:54:54.705056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686264+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:54:54.686264+0000","last_peered":"2023-10-06T03:54:54.686264+0000","last_clean":"2023-10-06T03:54:54.686264+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:54:54.686264+0000","last_undegraded":"2023-10-06T03:54:54.686264+0000","last_fullsized":"2023-10-06T03:54:54.686264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680747+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:54:54.680747+0000","last_peered":"2023-10-06T03:54:54.680747+0000","last_clean":"2023-10-06T03:54:54.680747+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:54:54.680747+0000","last_undegraded":"2023-10-06T03:54:54.680747+0000","last_fullsized":"2023-10-06T03:54:54.680747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685511+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:54:54.685511+0000","last_peered":"2023-10-06T03:54:54.685511+0000","last_clean":"2023-10-06T03:54:54.685511+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:54:54.685511+0000","last_undegraded":"2023-10-06T03:54:54.685511+0000","last_fullsized":"2023-10-06T03:54:54.685511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681986+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:54:54.681986+0000","last_peered":"2023-10-06T03:54:54.681986+0000","last_clean":"2023-10-06T03:54:54.681986+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:54:54.681986+0000","last_undegraded":"2023-10-06T03:54:54.681986+0000","last_fullsized":"2023-10-06T03:54:54.681986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682454+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:54:54.682454+0000","last_peered":"2023-10-06T03:54:54.682454+0000","last_clean":"2023-10-06T03:54:54.682454+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:54:54.682454+0000","last_undegraded":"2023-10-06T03:54:54.682454+0000","last_fullsized":"2023-10-06T03:54:54.682454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'31","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693858+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:54:54.693858+0000","last_peered":"2023-10-06T03:54:54.693858+0000","last_clean":"2023-10-06T03:54:54.693858+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:54:54.693858+0000","last_undegraded":"2023-10-06T03:54:54.693858+0000","last_fullsized":"2023-10-06T03:54:54.693858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.675641+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:54:54.675641+0000","last_peered":"2023-10-06T03:54:54.675641+0000","last_clean":"2023-10-06T03:54:54.675641+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:54:54.675641+0000","last_undegraded":"2023-10-06T03:54:54.675641+0000","last_fullsized":"2023-10-06T03:54:54.675641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'32","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693040+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:54:54.693040+0000","last_peered":"2023-10-06T03:54:54.693040+0000","last_clean":"2023-10-06T03:54:54.693040+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:54:54.693040+0000","last_undegraded":"2023-10-06T03:54:54.693040+0000","last_fullsized":"2023-10-06T03:54:54.693040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511750+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:54:27.511750+0000","last_peered":"2023-10-06T03:54:27.511750+0000","last_clean":"2023-10-06T03:54:27.511750+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:54:27.511750+0000","last_undegraded":"2023-10-06T03:54:27.511750+0000","last_fullsized":"2023-10-06T03:54:27.511750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680552+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:54:54.680552+0000","last_peered":"2023-10-06T03:54:54.680552+0000","last_clean":"2023-10-06T03:54:54.680552+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:54:54.680552+0000","last_undegraded":"2023-10-06T03:54:54.680552+0000","last_fullsized":"2023-10-06T03:54:54.680552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.319604+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:54:26.319604+0000","last_peered":"2023-10-06T03:54:26.319604+0000","last_clean":"2023-10-06T03:54:26.319604+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:54:26.319604+0000","last_undegraded":"2023-10-06T03:54:26.319604+0000","last_fullsized":"2023-10-06T03:54:26.319604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688175+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:54:54.688175+0000","last_peered":"2023-10-06T03:54:54.688175+0000","last_clean":"2023-10-06T03:54:54.688175+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:54:54.688175+0000","last_undegraded":"2023-10-06T03:54:54.688175+0000","last_fullsized":"2023-10-06T03:54:54.688175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442518+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:54:25.442518+0000","last_peered":"2023-10-06T03:54:25.442518+0000","last_clean":"2023-10-06T03:54:25.442518+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:54:25.442518+0000","last_undegraded":"2023-10-06T03:54:25.442518+0000","last_fullsized":"2023-10-06T03:54:25.442518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683628+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:54:54.683628+0000","last_peered":"2023-10-06T03:54:54.683628+0000","last_clean":"2023-10-06T03:54:54.683628+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:54:54.683628+0000","last_undegraded":"2023-10-06T03:54:54.683628+0000","last_fullsized":"2023-10-06T03:54:54.683628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511118+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:54:27.511118+0000","last_peered":"2023-10-06T03:54:27.511118+0000","last_clean":"2023-10-06T03:54:27.511118+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:54:27.511118+0000","last_undegraded":"2023-10-06T03:54:27.511118+0000","last_fullsized":"2023-10-06T03:54:27.511118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442576+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:54:25.442576+0000","last_peered":"2023-10-06T03:54:25.442576+0000","last_clean":"2023-10-06T03:54:25.442576+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:54:25.442576+0000","last_undegraded":"2023-10-06T03:54:25.442576+0000","last_fullsized":"2023-10-06T03:54:25.442576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681999+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:54:54.681999+0000","last_peered":"2023-10-06T03:54:54.681999+0000","last_clean":"2023-10-06T03:54:54.681999+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:54:54.681999+0000","last_undegraded":"2023-10-06T03:54:54.681999+0000","last_fullsized":"2023-10-06T03:54:54.681999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441963+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:54:25.441963+0000","last_peered":"2023-10-06T03:54:25.441963+0000","last_clean":"2023-10-06T03:54:25.441963+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:54:25.441963+0000","last_undegraded":"2023-10-06T03:54:25.441963+0000","last_fullsized":"2023-10-06T03:54:25.441963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'9","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.659454+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:54:54.659454+0000","last_peered":"2023-10-06T03:54:54.659454+0000","last_clean":"2023-10-06T03:54:54.659454+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:54:54.659454+0000","last_undegraded":"2023-10-06T03:54:54.659454+0000","last_fullsized":"2023-10-06T03:54:54.659454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442071+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:54:25.442071+0000","last_peered":"2023-10-06T03:54:25.442071+0000","last_clean":"2023-10-06T03:54:25.442071+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:54:25.442071+0000","last_undegraded":"2023-10-06T03:54:25.442071+0000","last_fullsized":"2023-10-06T03:54:25.442071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686059+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:54:54.686059+0000","last_peered":"2023-10-06T03:54:54.686059+0000","last_clean":"2023-10-06T03:54:54.686059+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:54:54.686059+0000","last_undegraded":"2023-10-06T03:54:54.686059+0000","last_fullsized":"2023-10-06T03:54:54.686059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322645+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:54:26.322645+0000","last_peered":"2023-10-06T03:54:26.322645+0000","last_clean":"2023-10-06T03:54:26.322645+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:54:26.322645+0000","last_undegraded":"2023-10-06T03:54:26.322645+0000","last_fullsized":"2023-10-06T03:54:26.322645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693248+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:54:54.693248+0000","last_peered":"2023-10-06T03:54:54.693248+0000","last_clean":"2023-10-06T03:54:54.693248+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:54:54.693248+0000","last_undegraded":"2023-10-06T03:54:54.693248+0000","last_fullsized":"2023-10-06T03:54:54.693248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318742+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:54:26.318742+0000","last_peered":"2023-10-06T03:54:26.318742+0000","last_clean":"2023-10-06T03:54:26.318742+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:54:26.318742+0000","last_undegraded":"2023-10-06T03:54:26.318742+0000","last_fullsized":"2023-10-06T03:54:26.318742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684017+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:54:54.684017+0000","last_peered":"2023-10-06T03:54:54.684017+0000","last_clean":"2023-10-06T03:54:54.684017+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:54:54.684017+0000","last_undegraded":"2023-10-06T03:54:54.684017+0000","last_fullsized":"2023-10-06T03:54:54.684017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511337+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:54:27.511337+0000","last_peered":"2023-10-06T03:54:27.511337+0000","last_clean":"2023-10-06T03:54:27.511337+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:54:27.511337+0000","last_undegraded":"2023-10-06T03:54:27.511337+0000","last_fullsized":"2023-10-06T03:54:27.511337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691133+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:54:54.691133+0000","last_peered":"2023-10-06T03:54:54.691133+0000","last_clean":"2023-10-06T03:54:54.691133+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:54:54.691133+0000","last_undegraded":"2023-10-06T03:54:54.691133+0000","last_fullsized":"2023-10-06T03:54:54.691133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307450+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:54:25.307450+0000","last_peered":"2023-10-06T03:54:25.307450+0000","last_clean":"2023-10-06T03:54:25.307450+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:54:25.307450+0000","last_undegraded":"2023-10-06T03:54:25.307450+0000","last_fullsized":"2023-10-06T03:54:25.307450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683144+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:54:54.683144+0000","last_peered":"2023-10-06T03:54:54.683144+0000","last_clean":"2023-10-06T03:54:54.683144+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:54:54.683144+0000","last_undegraded":"2023-10-06T03:54:54.683144+0000","last_fullsized":"2023-10-06T03:54:54.683144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318339+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:54:26.318339+0000","last_peered":"2023-10-06T03:54:26.318339+0000","last_clean":"2023-10-06T03:54:26.318339+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:54:26.318339+0000","last_undegraded":"2023-10-06T03:54:26.318339+0000","last_fullsized":"2023-10-06T03:54:26.318339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687775+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:54:54.687775+0000","last_peered":"2023-10-06T03:54:54.687775+0000","last_clean":"2023-10-06T03:54:54.687775+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:54:54.687775+0000","last_undegraded":"2023-10-06T03:54:54.687775+0000","last_fullsized":"2023-10-06T03:54:54.687775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441398+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:54:25.441398+0000","last_peered":"2023-10-06T03:54:25.441398+0000","last_clean":"2023-10-06T03:54:25.441398+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:54:25.441398+0000","last_undegraded":"2023-10-06T03:54:25.441398+0000","last_fullsized":"2023-10-06T03:54:25.441398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317159+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:54:25.317159+0000","last_peered":"2023-10-06T03:54:25.317159+0000","last_clean":"2023-10-06T03:54:25.317159+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:54:25.317159+0000","last_undegraded":"2023-10-06T03:54:25.317159+0000","last_fullsized":"2023-10-06T03:54:25.317159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.306186+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:54:25.306186+0000","last_peered":"2023-10-06T03:54:25.306186+0000","last_clean":"2023-10-06T03:54:25.306186+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:54:25.306186+0000","last_undegraded":"2023-10-06T03:54:25.306186+0000","last_fullsized":"2023-10-06T03:54:25.306186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683268+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:54:54.683268+0000","last_peered":"2023-10-06T03:54:54.683268+0000","last_clean":"2023-10-06T03:54:54.683268+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:54:54.683268+0000","last_undegraded":"2023-10-06T03:54:54.683268+0000","last_fullsized":"2023-10-06T03:54:54.683268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441157+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:54:25.441157+0000","last_peered":"2023-10-06T03:54:25.441157+0000","last_clean":"2023-10-06T03:54:25.441157+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:54:25.441157+0000","last_undegraded":"2023-10-06T03:54:25.441157+0000","last_fullsized":"2023-10-06T03:54:25.441157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.697685+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:54:54.697685+0000","last_peered":"2023-10-06T03:54:54.697685+0000","last_clean":"2023-10-06T03:54:54.697685+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:54:54.697685+0000","last_undegraded":"2023-10-06T03:54:54.697685+0000","last_fullsized":"2023-10-06T03:54:54.697685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693738+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:54:54.693738+0000","last_peered":"2023-10-06T03:54:54.693738+0000","last_clean":"2023-10-06T03:54:54.693738+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:54:54.693738+0000","last_undegraded":"2023-10-06T03:54:54.693738+0000","last_fullsized":"2023-10-06T03:54:54.693738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.314504+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:54:25.314504+0000","last_peered":"2023-10-06T03:54:25.314504+0000","last_clean":"2023-10-06T03:54:25.314504+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:54:25.314504+0000","last_undegraded":"2023-10-06T03:54:25.314504+0000","last_fullsized":"2023-10-06T03:54:25.314504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.163355+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:54:27.163355+0000","last_peered":"2023-10-06T03:54:27.163355+0000","last_clean":"2023-10-06T03:54:27.163355+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:54:27.163355+0000","last_undegraded":"2023-10-06T03:54:27.163355+0000","last_fullsized":"2023-10-06T03:54:27.163355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686184+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:54:54.686184+0000","last_peered":"2023-10-06T03:54:54.686184+0000","last_clean":"2023-10-06T03:54:54.686184+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:54:54.686184+0000","last_undegraded":"2023-10-06T03:54:54.686184+0000","last_fullsized":"2023-10-06T03:54:54.686184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317127+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:54:25.317127+0000","last_peered":"2023-10-06T03:54:25.317127+0000","last_clean":"2023-10-06T03:54:25.317127+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:54:25.317127+0000","last_undegraded":"2023-10-06T03:54:25.317127+0000","last_fullsized":"2023-10-06T03:54:25.317127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.308030+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:54:25.308030+0000","last_peered":"2023-10-06T03:54:25.308030+0000","last_clean":"2023-10-06T03:54:25.308030+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:54:25.308030+0000","last_undegraded":"2023-10-06T03:54:25.308030+0000","last_fullsized":"2023-10-06T03:54:25.308030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'26","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680025+0000","last_change":"2023-10-06T03:54:26.783934+0000","last_active":"2023-10-06T03:54:54.680025+0000","last_peered":"2023-10-06T03:54:54.680025+0000","last_clean":"2023-10-06T03:54:54.680025+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:54:54.680025+0000","last_undegraded":"2023-10-06T03:54:54.680025+0000","last_fullsized":"2023-10-06T03:54:54.680025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:52.067892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.318195+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:54:25.318195+0000","last_peered":"2023-10-06T03:54:25.318195+0000","last_clean":"2023-10-06T03:54:25.318195+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:54:25.318195+0000","last_undegraded":"2023-10-06T03:54:25.318195+0000","last_fullsized":"2023-10-06T03:54:25.318195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321701+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:54:25.321701+0000","last_peered":"2023-10-06T03:54:25.321701+0000","last_clean":"2023-10-06T03:54:25.321701+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:54:25.321701+0000","last_undegraded":"2023-10-06T03:54:25.321701+0000","last_fullsized":"2023-10-06T03:54:25.321701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685066+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:54:54.685066+0000","last_peered":"2023-10-06T03:54:54.685066+0000","last_clean":"2023-10-06T03:54:54.685066+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:54:54.685066+0000","last_undegraded":"2023-10-06T03:54:54.685066+0000","last_fullsized":"2023-10-06T03:54:54.685066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321605+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:54:25.321605+0000","last_peered":"2023-10-06T03:54:25.321605+0000","last_clean":"2023-10-06T03:54:25.321605+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:54:25.321605+0000","last_undegraded":"2023-10-06T03:54:25.321605+0000","last_fullsized":"2023-10-06T03:54:25.321605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442307+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:54:25.442307+0000","last_peered":"2023-10-06T03:54:25.442307+0000","last_clean":"2023-10-06T03:54:25.442307+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:54:25.442307+0000","last_undegraded":"2023-10-06T03:54:25.442307+0000","last_fullsized":"2023-10-06T03:54:25.442307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682160+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:54:54.682160+0000","last_peered":"2023-10-06T03:54:54.682160+0000","last_clean":"2023-10-06T03:54:54.682160+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:54:54.682160+0000","last_undegraded":"2023-10-06T03:54:54.682160+0000","last_fullsized":"2023-10-06T03:54:54.682160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318970+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:54:26.318970+0000","last_peered":"2023-10-06T03:54:26.318970+0000","last_clean":"2023-10-06T03:54:26.318970+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:54:26.318970+0000","last_undegraded":"2023-10-06T03:54:26.318970+0000","last_fullsized":"2023-10-06T03:54:26.318970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321818+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:54:25.321818+0000","last_peered":"2023-10-06T03:54:25.321818+0000","last_clean":"2023-10-06T03:54:25.321818+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:54:25.321818+0000","last_undegraded":"2023-10-06T03:54:25.321818+0000","last_fullsized":"2023-10-06T03:54:25.321818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682334+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:54:54.682334+0000","last_peered":"2023-10-06T03:54:54.682334+0000","last_clean":"2023-10-06T03:54:54.682334+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:54:54.682334+0000","last_undegraded":"2023-10-06T03:54:54.682334+0000","last_fullsized":"2023-10-06T03:54:54.682334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:49.597324+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:54:49.597324+0000","last_peered":"2023-10-06T03:54:49.597324+0000","last_clean":"2023-10-06T03:54:49.597324+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:54:49.597324+0000","last_undegraded":"2023-10-06T03:54:49.597324+0000","last_fullsized":"2023-10-06T03:54:49.597324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442543+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:54:25.442543+0000","last_peered":"2023-10-06T03:54:25.442543+0000","last_clean":"2023-10-06T03:54:25.442543+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:54:25.442543+0000","last_undegraded":"2023-10-06T03:54:25.442543+0000","last_fullsized":"2023-10-06T03:54:25.442543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.690041+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:54:54.690041+0000","last_peered":"2023-10-06T03:54:54.690041+0000","last_clean":"2023-10-06T03:54:54.690041+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:54:54.690041+0000","last_undegraded":"2023-10-06T03:54:54.690041+0000","last_fullsized":"2023-10-06T03:54:54.690041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'46","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691334+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:54:54.691334+0000","last_peered":"2023-10-06T03:54:54.691334+0000","last_clean":"2023-10-06T03:54:54.691334+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:54:54.691334+0000","last_undegraded":"2023-10-06T03:54:54.691334+0000","last_fullsized":"2023-10-06T03:54:54.691334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'104","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:55.747782+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:54:55.747782+0000","last_peered":"2023-10-06T03:54:55.747782+0000","last_clean":"2023-10-06T03:54:55.747782+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:54:55.747782+0000","last_undegraded":"2023-10-06T03:54:55.747782+0000","last_fullsized":"2023-10-06T03:54:55.747782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407920,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.677320+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:54:54.677320+0000","last_peered":"2023-10-06T03:54:54.677320+0000","last_clean":"2023-10-06T03:54:54.677320+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:54:54.677320+0000","last_undegraded":"2023-10-06T03:54:54.677320+0000","last_fullsized":"2023-10-06T03:54:54.677320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'11","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:53.707912+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:54:53.707912+0000","last_peered":"2023-10-06T03:54:53.707912+0000","last_clean":"2023-10-06T03:54:53.707912+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:54:53.707912+0000","last_undegraded":"2023-10-06T03:54:53.707912+0000","last_fullsized":"2023-10-06T03:54:53.707912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322868+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:54:26.322868+0000","last_peered":"2023-10-06T03:54:26.322868+0000","last_clean":"2023-10-06T03:54:26.322868+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:54:26.322868+0000","last_undegraded":"2023-10-06T03:54:26.322868+0000","last_fullsized":"2023-10-06T03:54:26.322868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682370+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:54:54.682370+0000","last_peered":"2023-10-06T03:54:54.682370+0000","last_clean":"2023-10-06T03:54:54.682370+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:54:54.682370+0000","last_undegraded":"2023-10-06T03:54:54.682370+0000","last_fullsized":"2023-10-06T03:54:54.682370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320410+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:54:26.320410+0000","last_peered":"2023-10-06T03:54:26.320410+0000","last_clean":"2023-10-06T03:54:26.320410+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:54:26.320410+0000","last_undegraded":"2023-10-06T03:54:26.320410+0000","last_fullsized":"2023-10-06T03:54:26.320410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692340+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:54:54.692340+0000","last_peered":"2023-10-06T03:54:54.692340+0000","last_clean":"2023-10-06T03:54:54.692340+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:54:54.692340+0000","last_undegraded":"2023-10-06T03:54:54.692340+0000","last_fullsized":"2023-10-06T03:54:54.692340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674969+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:54:54.674969+0000","last_peered":"2023-10-06T03:54:54.674969+0000","last_clean":"2023-10-06T03:54:54.674969+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:54:54.674969+0000","last_undegraded":"2023-10-06T03:54:54.674969+0000","last_fullsized":"2023-10-06T03:54:54.674969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.305861+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:54:25.305861+0000","last_peered":"2023-10-06T03:54:25.305861+0000","last_clean":"2023-10-06T03:54:25.305861+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:54:25.305861+0000","last_undegraded":"2023-10-06T03:54:25.305861+0000","last_fullsized":"2023-10-06T03:54:25.305861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683307+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:54:54.683307+0000","last_peered":"2023-10-06T03:54:54.683307+0000","last_clean":"2023-10-06T03:54:54.683307+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:54:54.683307+0000","last_undegraded":"2023-10-06T03:54:54.683307+0000","last_fullsized":"2023-10-06T03:54:54.683307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.702690+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:54:46.702690+0000","last_peered":"2023-10-06T03:54:46.702690+0000","last_clean":"2023-10-06T03:54:46.702690+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:54:46.702690+0000","last_undegraded":"2023-10-06T03:54:46.702690+0000","last_fullsized":"2023-10-06T03:54:46.702690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693364+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:54:54.693364+0000","last_peered":"2023-10-06T03:54:54.693364+0000","last_clean":"2023-10-06T03:54:54.693364+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:54:54.693364+0000","last_undegraded":"2023-10-06T03:54:54.693364+0000","last_fullsized":"2023-10-06T03:54:54.693364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307756+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:54:25.307756+0000","last_peered":"2023-10-06T03:54:25.307756+0000","last_clean":"2023-10-06T03:54:25.307756+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:54:25.307756+0000","last_undegraded":"2023-10-06T03:54:25.307756+0000","last_fullsized":"2023-10-06T03:54:25.307756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692904+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:54:54.692904+0000","last_peered":"2023-10-06T03:54:54.692904+0000","last_clean":"2023-10-06T03:54:54.692904+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:54:54.692904+0000","last_undegraded":"2023-10-06T03:54:54.692904+0000","last_fullsized":"2023-10-06T03:54:54.692904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320056+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:54:26.320056+0000","last_peered":"2023-10-06T03:54:26.320056+0000","last_clean":"2023-10-06T03:54:26.320056+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:54:26.320056+0000","last_undegraded":"2023-10-06T03:54:26.320056+0000","last_fullsized":"2023-10-06T03:54:26.320056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686775+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:54:54.686775+0000","last_peered":"2023-10-06T03:54:54.686775+0000","last_clean":"2023-10-06T03:54:54.686775+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:54:54.686775+0000","last_undegraded":"2023-10-06T03:54:54.686775+0000","last_fullsized":"2023-10-06T03:54:54.686775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317777+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:54:25.317777+0000","last_peered":"2023-10-06T03:54:25.317777+0000","last_clean":"2023-10-06T03:54:25.317777+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:54:25.317777+0000","last_undegraded":"2023-10-06T03:54:25.317777+0000","last_fullsized":"2023-10-06T03:54:25.317777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691238+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:54:54.691238+0000","last_peered":"2023-10-06T03:54:54.691238+0000","last_clean":"2023-10-06T03:54:54.691238+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:54:54.691238+0000","last_undegraded":"2023-10-06T03:54:54.691238+0000","last_fullsized":"2023-10-06T03:54:54.691238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322849+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:54:26.322849+0000","last_peered":"2023-10-06T03:54:26.322849+0000","last_clean":"2023-10-06T03:54:26.322849+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:54:26.322849+0000","last_undegraded":"2023-10-06T03:54:26.322849+0000","last_fullsized":"2023-10-06T03:54:26.322849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687161+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:54:54.687161+0000","last_peered":"2023-10-06T03:54:54.687161+0000","last_clean":"2023-10-06T03:54:54.687161+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:54:54.687161+0000","last_undegraded":"2023-10-06T03:54:54.687161+0000","last_fullsized":"2023-10-06T03:54:54.687161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318654+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:54:26.318654+0000","last_peered":"2023-10-06T03:54:26.318654+0000","last_clean":"2023-10-06T03:54:26.318654+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:54:26.318654+0000","last_undegraded":"2023-10-06T03:54:26.318654+0000","last_fullsized":"2023-10-06T03:54:26.318654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683856+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:54:54.683856+0000","last_peered":"2023-10-06T03:54:54.683856+0000","last_clean":"2023-10-06T03:54:54.683856+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:54:54.683856+0000","last_undegraded":"2023-10-06T03:54:54.683856+0000","last_fullsized":"2023-10-06T03:54:54.683856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320336+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:54:26.320336+0000","last_peered":"2023-10-06T03:54:26.320336+0000","last_clean":"2023-10-06T03:54:26.320336+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:54:26.320336+0000","last_undegraded":"2023-10-06T03:54:26.320336+0000","last_fullsized":"2023-10-06T03:54:26.320336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":413437,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":165,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":892928,"data_stored":826874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":1100059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.046},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.139}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.244}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.419},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0740000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":109960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.141}]},{"osd":1,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.746},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1659999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.107}]},{"osd":7,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.085},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.0589999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.044}]},{"osd":1,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.999}]},{"osd":2,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.135}]},{"osd":4,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.161},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.206}]},{"osd":7,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.177}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":720896,"data_stored":514291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.288}]},{"osd":5,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.871},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.026}]},{"osd":6,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.131},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.4770000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.432},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.94799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.151},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747}]},{"osd":1,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.321},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.002}]},{"osd":6,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.177},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.397}]},{"osd":7,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.29},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.246}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301668,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3280000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.997}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.091}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4419999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":892928,"data_stored":705620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.113},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.5149999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.93999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":5301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":412723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":408136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:54:59.365 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:54:59.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:54:59.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 Processor -- start 2023-10-06T03:54:59.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 -- start start 2023-10-06T03:54:59.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f68c80b0950 0x7f68c80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68c8142340 0x7f68c81427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c80b20e0 con 0x7f68c81464c0 2023-10-06T03:54:59.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c80ac360 con 0x7f68c8142340 2023-10-06T03:54:59.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ceeaa700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c81459e0 con 0x7f68c80b0950 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68c8142340 0x7f68c81427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68cd6a7700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f68c81464c0 0x7f68c80b0d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36250/0 (socket says 172.21.15.57:36250) 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68cd6a7700 1 -- 172.21.15.57:0/1474848767 learned_addr learned my addr 172.21.15.57:0/1474848767 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68cdea8700 1 --2- 172.21.15.57:0/1474848767 >> v2:172.21.15.105:3300/0 conn(0x7f68c80b0950 0x7f68c80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 -- 172.21.15.57:0/1474848767 >> v2:172.21.15.105:3300/0 conn(0x7f68c80b0950 msgr2=0x7f68c80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 --2- 172.21.15.57:0/1474848767 >> v2:172.21.15.105:3300/0 conn(0x7f68c80b0950 0x7f68c80b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 -- 172.21.15.57:0/1474848767 >> v1:172.21.15.57:6789/0 conn(0x7f68c81464c0 legacy=0x7f68c80b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 -- 172.21.15.57:0/1474848767 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8145cc0 con 0x7f68c8142340 2023-10-06T03:54:59.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.467+0000 7f68ce6a9700 1 --2- 172.21.15.57:0/1474848767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c8142340 0x7f68c81427a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68c80686f0 tx=0x7f68c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2abc3440a9608b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ccea6700 1 -- 172.21.15.57:0/1474848767 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000e070 con 0x7f68c8142340 2023-10-06T03:54:59.474 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ccea6700 1 -- 172.21.15.57:0/1474848767 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c000bb60 con 0x7f68c8142340 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ccea6700 1 -- 172.21.15.57:0/1474848767 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0012430 con 0x7f68c8142340 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1474848767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c8142340 msgr2=0x7f68c81427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1474848767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c8142340 0x7f68c81427a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f68c80686f0 tx=0x7f68c0009780 comp rx=0 tx=0).stop 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1474848767 shutdown_connections 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1474848767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c8142340 0x7f68c81427a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1474848767 >> v2:172.21.15.105:3300/0 conn(0x7f68c80b0950 0x7f68c80b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1474848767 >> 172.21.15.57:0/1474848767 conn(0x7f68c8068f20 msgr2=0x7f68c8069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1474848767 shutdown_connections 2023-10-06T03:54:59.475 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1474848767 wait complete. 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 Processor -- start 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.471+0000 7f68ceeaa700 1 -- start start 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c8142340 0x7f68c8152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c81464c0 0x7f68c8152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.479 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c813ed90 con 0x7f68c80b0950 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80add90 con 0x7f68c8142340 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80ad070 con 0x7f68c81464c0 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43076/0 (socket says 172.21.15.57:43076) 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 -- 172.21.15.57:0/1001423052 learned_addr learned my addr 172.21.15.57:0/1001423052 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:59.480 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cd6a7700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c8142340 0x7f68c8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ce6a9700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c81464c0 0x7f68c8152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 -- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c81464c0 msgr2=0x7f68c8152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c81464c0 0x7f68c8152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 -- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c8142340 msgr2=0x7f68c8152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c8142340 0x7f68c8152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 -- 172.21.15.57:0/1001423052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c0009a20 con 0x7f68c80b0950 2023-10-06T03:54:59.481 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68cdea8700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68c400e960 tx=0x7f68c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4013680 con 0x7f68c80b0950 2023-10-06T03:54:59.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c40137e0 con 0x7f68c80b0950 2023-10-06T03:54:59.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c80ae3e0 con 0x7f68c80b0950 2023-10-06T03:54:59.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4013b80 con 0x7f68c80b0950 2023-10-06T03:54:59.482 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c80acd00 con 0x7f68c80b0950 2023-10-06T03:54:59.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.475+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c806a300 con 0x7f68c80b0950 2023-10-06T03:54:59.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.479+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f68c40123d0 con 0x7f68c80b0950 2023-10-06T03:54:59.483 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.479+0000 7f68bdffb700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 0x7f68ac062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.479+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f68c407cd60 con 0x7f68c80b0950 2023-10-06T03:54:59.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.479+0000 7f68cd6a7700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 0x7f68ac062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.484 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.479+0000 7f68cd6a7700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 0x7f68ac062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68c8143160 tx=0x7f68b8007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.487+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f68c404d1b0 con 0x7f68c80b0950 2023-10-06T03:54:59.647 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.643+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68c80ad1b0 con 0x7f68ac060550 2023-10-06T03:54:59.665 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.659+0000 7f68bdffb700 1 -- 172.21.15.57:0/1001423052 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309366 (secure 0 0 0) 0x7f68b8004ce0 con 0x7f68ac060550 2023-10-06T03:54:59.668 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:54:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 msgr2=0x7f68ac062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 0x7f68ac062a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68c8143160 tx=0x7f68b8007eb0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 msgr2=0x7f68c80ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f68c400e960 tx=0x7f68c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 shutdown_connections 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f68ac060550 0x7f68ac062a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c81464c0 0x7f68c8152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c8142340 0x7f68c8152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 --2- 172.21.15.57:0/1001423052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68c80b0950 0x7f68c80ad850 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 >> 172.21.15.57:0/1001423052 conn(0x7f68c8068f20 msgr2=0x7f68c813b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 shutdown_connections 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.667+0000 7f68ceeaa700 1 -- 172.21.15.57:0/1001423052 wait complete. 2023-10-06T03:54:59.672 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:54:59.688 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-06T03:54:58.652967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1003818,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":126,"num_read_kb":113,"num_write":368,"num_write_kb":2927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1860,"ondisk_log_size":1860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403060,"kb_used_data":4272,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571660,"statfs":{"total":773094113280,"available":770633379840,"internally_reserved":0,"allocated":4374528,"data_stored":2870452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196046,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":87,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006252"},"pg_stats":[{"pgid":"4.3f","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683577+0000","last_change":"2023-10-06T03:53:44.662210+0000","last_active":"2023-10-06T03:54:54.683577+0000","last_peered":"2023-10-06T03:54:54.683577+0000","last_clean":"2023-10-06T03:54:54.683577+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:54:54.683577+0000","last_undegraded":"2023-10-06T03:54:54.683577+0000","last_fullsized":"2023-10-06T03:54:54.683577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'14","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685242+0000","last_change":"2023-10-06T03:53:44.665648+0000","last_active":"2023-10-06T03:54:54.685242+0000","last_peered":"2023-10-06T03:54:54.685242+0000","last_clean":"2023-10-06T03:54:54.685242+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:54:54.685242+0000","last_undegraded":"2023-10-06T03:54:54.685242+0000","last_fullsized":"2023-10-06T03:54:54.685242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689931+0000","last_change":"2023-10-06T03:53:44.663187+0000","last_active":"2023-10-06T03:54:54.689931+0000","last_peered":"2023-10-06T03:54:54.689931+0000","last_clean":"2023-10-06T03:54:54.689931+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:54:54.689931+0000","last_undegraded":"2023-10-06T03:54:54.689931+0000","last_fullsized":"2023-10-06T03:54:54.689931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682618+0000","last_change":"2023-10-06T03:53:44.662122+0000","last_active":"2023-10-06T03:54:54.682618+0000","last_peered":"2023-10-06T03:54:54.682618+0000","last_clean":"2023-10-06T03:54:54.682618+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:54:54.682618+0000","last_undegraded":"2023-10-06T03:54:54.682618+0000","last_fullsized":"2023-10-06T03:54:54.682618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687151+0000","last_change":"2023-10-06T03:53:44.659209+0000","last_active":"2023-10-06T03:54:54.687151+0000","last_peered":"2023-10-06T03:54:54.687151+0000","last_clean":"2023-10-06T03:54:54.687151+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:54:54.687151+0000","last_undegraded":"2023-10-06T03:54:54.687151+0000","last_fullsized":"2023-10-06T03:54:54.687151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683719+0000","last_change":"2023-10-06T03:53:44.655631+0000","last_active":"2023-10-06T03:54:54.683719+0000","last_peered":"2023-10-06T03:54:54.683719+0000","last_clean":"2023-10-06T03:54:54.683719+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:54:54.683719+0000","last_undegraded":"2023-10-06T03:54:54.683719+0000","last_fullsized":"2023-10-06T03:54:54.683719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'16","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692180+0000","last_change":"2023-10-06T03:53:44.662491+0000","last_active":"2023-10-06T03:54:54.692180+0000","last_peered":"2023-10-06T03:54:54.692180+0000","last_clean":"2023-10-06T03:54:54.692180+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:54:54.692180+0000","last_undegraded":"2023-10-06T03:54:54.692180+0000","last_fullsized":"2023-10-06T03:54:54.692180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687166+0000","last_change":"2023-10-06T03:53:44.655682+0000","last_active":"2023-10-06T03:54:54.687166+0000","last_peered":"2023-10-06T03:54:54.687166+0000","last_clean":"2023-10-06T03:54:54.687166+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:54:54.687166+0000","last_undegraded":"2023-10-06T03:54:54.687166+0000","last_fullsized":"2023-10-06T03:54:54.687166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'28","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687577+0000","last_change":"2023-10-06T03:53:44.668756+0000","last_active":"2023-10-06T03:54:54.687577+0000","last_peered":"2023-10-06T03:54:54.687577+0000","last_clean":"2023-10-06T03:54:54.687577+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:54:54.687577+0000","last_undegraded":"2023-10-06T03:54:54.687577+0000","last_fullsized":"2023-10-06T03:54:54.687577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'43","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684561+0000","last_change":"2023-10-06T03:53:44.668983+0000","last_active":"2023-10-06T03:54:54.684561+0000","last_peered":"2023-10-06T03:54:54.684561+0000","last_clean":"2023-10-06T03:54:54.684561+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:54:54.684561+0000","last_undegraded":"2023-10-06T03:54:54.684561+0000","last_fullsized":"2023-10-06T03:54:54.684561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686050+0000","last_change":"2023-10-06T03:53:44.660091+0000","last_active":"2023-10-06T03:54:54.686050+0000","last_peered":"2023-10-06T03:54:54.686050+0000","last_clean":"2023-10-06T03:54:54.686050+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:54:54.686050+0000","last_undegraded":"2023-10-06T03:54:54.686050+0000","last_fullsized":"2023-10-06T03:54:54.686050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688841+0000","last_change":"2023-10-06T03:53:44.664632+0000","last_active":"2023-10-06T03:54:54.688841+0000","last_peered":"2023-10-06T03:54:54.688841+0000","last_clean":"2023-10-06T03:54:54.688841+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:54:54.688841+0000","last_undegraded":"2023-10-06T03:54:54.688841+0000","last_fullsized":"2023-10-06T03:54:54.688841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683658+0000","last_change":"2023-10-06T03:53:44.665896+0000","last_active":"2023-10-06T03:54:54.683658+0000","last_peered":"2023-10-06T03:54:54.683658+0000","last_clean":"2023-10-06T03:54:54.683658+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:54:54.683658+0000","last_undegraded":"2023-10-06T03:54:54.683658+0000","last_fullsized":"2023-10-06T03:54:54.683658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674574+0000","last_change":"2023-10-06T03:53:44.664859+0000","last_active":"2023-10-06T03:54:54.674574+0000","last_peered":"2023-10-06T03:54:54.674574+0000","last_clean":"2023-10-06T03:54:54.674574+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:54:54.674574+0000","last_undegraded":"2023-10-06T03:54:54.674574+0000","last_fullsized":"2023-10-06T03:54:54.674574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692613+0000","last_change":"2023-10-06T03:53:44.662631+0000","last_active":"2023-10-06T03:54:54.692613+0000","last_peered":"2023-10-06T03:54:54.692613+0000","last_clean":"2023-10-06T03:54:54.692613+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:54:54.692613+0000","last_undegraded":"2023-10-06T03:54:54.692613+0000","last_fullsized":"2023-10-06T03:54:54.692613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691301+0000","last_change":"2023-10-06T03:53:44.655683+0000","last_active":"2023-10-06T03:54:54.691301+0000","last_peered":"2023-10-06T03:54:54.691301+0000","last_clean":"2023-10-06T03:54:54.691301+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:54:54.691301+0000","last_undegraded":"2023-10-06T03:54:54.691301+0000","last_fullsized":"2023-10-06T03:54:54.691301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'24","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680941+0000","last_change":"2023-10-06T03:54:26.787211+0000","last_active":"2023-10-06T03:54:54.680941+0000","last_peered":"2023-10-06T03:54:54.680941+0000","last_clean":"2023-10-06T03:54:54.680941+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:54:54.680941+0000","last_undegraded":"2023-10-06T03:54:54.680941+0000","last_fullsized":"2023-10-06T03:54:54.680941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.190393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'39","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.701054+0000","last_change":"2023-10-06T03:53:44.664064+0000","last_active":"2023-10-06T03:54:54.701054+0000","last_peered":"2023-10-06T03:54:54.701054+0000","last_clean":"2023-10-06T03:54:54.701054+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:54:54.701054+0000","last_undegraded":"2023-10-06T03:54:54.701054+0000","last_fullsized":"2023-10-06T03:54:54.701054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.676699+0000","last_change":"2023-10-06T03:53:44.671465+0000","last_active":"2023-10-06T03:54:54.676699+0000","last_peered":"2023-10-06T03:54:54.676699+0000","last_clean":"2023-10-06T03:54:54.676699+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:54:54.676699+0000","last_undegraded":"2023-10-06T03:54:54.676699+0000","last_fullsized":"2023-10-06T03:54:54.676699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.689949+0000","last_change":"2023-10-06T03:53:44.660036+0000","last_active":"2023-10-06T03:54:54.689949+0000","last_peered":"2023-10-06T03:54:54.689949+0000","last_clean":"2023-10-06T03:54:54.689949+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:54:54.689949+0000","last_undegraded":"2023-10-06T03:54:54.689949+0000","last_fullsized":"2023-10-06T03:54:54.689949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'33","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680724+0000","last_change":"2023-10-06T03:53:44.673407+0000","last_active":"2023-10-06T03:54:54.680724+0000","last_peered":"2023-10-06T03:54:54.680724+0000","last_clean":"2023-10-06T03:54:54.680724+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:54:54.680724+0000","last_undegraded":"2023-10-06T03:54:54.680724+0000","last_fullsized":"2023-10-06T03:54:54.680724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692819+0000","last_change":"2023-10-06T03:53:44.662003+0000","last_active":"2023-10-06T03:54:54.692819+0000","last_peered":"2023-10-06T03:54:54.692819+0000","last_clean":"2023-10-06T03:54:54.692819+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:54:54.692819+0000","last_undegraded":"2023-10-06T03:54:54.692819+0000","last_fullsized":"2023-10-06T03:54:54.692819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684467+0000","last_change":"2023-10-06T03:53:44.673046+0000","last_active":"2023-10-06T03:54:54.684467+0000","last_peered":"2023-10-06T03:54:54.684467+0000","last_clean":"2023-10-06T03:54:54.684467+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:54:54.684467+0000","last_undegraded":"2023-10-06T03:54:54.684467+0000","last_fullsized":"2023-10-06T03:54:54.684467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687655+0000","last_change":"2023-10-06T03:53:44.661181+0000","last_active":"2023-10-06T03:54:54.687655+0000","last_peered":"2023-10-06T03:54:54.687655+0000","last_clean":"2023-10-06T03:54:54.687655+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:54:54.687655+0000","last_undegraded":"2023-10-06T03:54:54.687655+0000","last_fullsized":"2023-10-06T03:54:54.687655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.705056+0000","last_change":"2023-10-06T03:53:44.672616+0000","last_active":"2023-10-06T03:54:54.705056+0000","last_peered":"2023-10-06T03:54:54.705056+0000","last_clean":"2023-10-06T03:54:54.705056+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:54:54.705056+0000","last_undegraded":"2023-10-06T03:54:54.705056+0000","last_fullsized":"2023-10-06T03:54:54.705056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686264+0000","last_change":"2023-10-06T03:53:44.671192+0000","last_active":"2023-10-06T03:54:54.686264+0000","last_peered":"2023-10-06T03:54:54.686264+0000","last_clean":"2023-10-06T03:54:54.686264+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:54:54.686264+0000","last_undegraded":"2023-10-06T03:54:54.686264+0000","last_fullsized":"2023-10-06T03:54:54.686264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680747+0000","last_change":"2023-10-06T03:53:44.663576+0000","last_active":"2023-10-06T03:54:54.680747+0000","last_peered":"2023-10-06T03:54:54.680747+0000","last_clean":"2023-10-06T03:54:54.680747+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:54:54.680747+0000","last_undegraded":"2023-10-06T03:54:54.680747+0000","last_fullsized":"2023-10-06T03:54:54.680747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685511+0000","last_change":"2023-10-06T03:53:44.660454+0000","last_active":"2023-10-06T03:54:54.685511+0000","last_peered":"2023-10-06T03:54:54.685511+0000","last_clean":"2023-10-06T03:54:54.685511+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:54:54.685511+0000","last_undegraded":"2023-10-06T03:54:54.685511+0000","last_fullsized":"2023-10-06T03:54:54.685511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'21","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681986+0000","last_change":"2023-10-06T03:53:44.665103+0000","last_active":"2023-10-06T03:54:54.681986+0000","last_peered":"2023-10-06T03:54:54.681986+0000","last_clean":"2023-10-06T03:54:54.681986+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:54:54.681986+0000","last_undegraded":"2023-10-06T03:54:54.681986+0000","last_fullsized":"2023-10-06T03:54:54.681986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682454+0000","last_change":"2023-10-06T03:53:44.664212+0000","last_active":"2023-10-06T03:54:54.682454+0000","last_peered":"2023-10-06T03:54:54.682454+0000","last_clean":"2023-10-06T03:54:54.682454+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:54:54.682454+0000","last_undegraded":"2023-10-06T03:54:54.682454+0000","last_fullsized":"2023-10-06T03:54:54.682454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'31","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693858+0000","last_change":"2023-10-06T03:53:44.671536+0000","last_active":"2023-10-06T03:54:54.693858+0000","last_peered":"2023-10-06T03:54:54.693858+0000","last_clean":"2023-10-06T03:54:54.693858+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:54:54.693858+0000","last_undegraded":"2023-10-06T03:54:54.693858+0000","last_fullsized":"2023-10-06T03:54:54.693858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.675641+0000","last_change":"2023-10-06T03:53:44.664518+0000","last_active":"2023-10-06T03:54:54.675641+0000","last_peered":"2023-10-06T03:54:54.675641+0000","last_clean":"2023-10-06T03:54:54.675641+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:54:54.675641+0000","last_undegraded":"2023-10-06T03:54:54.675641+0000","last_fullsized":"2023-10-06T03:54:54.675641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'32","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693040+0000","last_change":"2023-10-06T03:53:44.669851+0000","last_active":"2023-10-06T03:54:54.693040+0000","last_peered":"2023-10-06T03:54:54.693040+0000","last_clean":"2023-10-06T03:54:54.693040+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:54:54.693040+0000","last_undegraded":"2023-10-06T03:54:54.693040+0000","last_fullsized":"2023-10-06T03:54:54.693040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511750+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:54:27.511750+0000","last_peered":"2023-10-06T03:54:27.511750+0000","last_clean":"2023-10-06T03:54:27.511750+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:54:27.511750+0000","last_undegraded":"2023-10-06T03:54:27.511750+0000","last_fullsized":"2023-10-06T03:54:27.511750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'24","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680552+0000","last_change":"2023-10-06T03:53:44.661057+0000","last_active":"2023-10-06T03:54:54.680552+0000","last_peered":"2023-10-06T03:54:54.680552+0000","last_clean":"2023-10-06T03:54:54.680552+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:54:54.680552+0000","last_undegraded":"2023-10-06T03:54:54.680552+0000","last_fullsized":"2023-10-06T03:54:54.680552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.319604+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:54:26.319604+0000","last_peered":"2023-10-06T03:54:26.319604+0000","last_clean":"2023-10-06T03:54:26.319604+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:54:26.319604+0000","last_undegraded":"2023-10-06T03:54:26.319604+0000","last_fullsized":"2023-10-06T03:54:26.319604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.688175+0000","last_change":"2023-10-06T03:53:44.668434+0000","last_active":"2023-10-06T03:54:54.688175+0000","last_peered":"2023-10-06T03:54:54.688175+0000","last_clean":"2023-10-06T03:54:54.688175+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:54:54.688175+0000","last_undegraded":"2023-10-06T03:54:54.688175+0000","last_fullsized":"2023-10-06T03:54:54.688175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442518+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:54:25.442518+0000","last_peered":"2023-10-06T03:54:25.442518+0000","last_clean":"2023-10-06T03:54:25.442518+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:54:25.442518+0000","last_undegraded":"2023-10-06T03:54:25.442518+0000","last_fullsized":"2023-10-06T03:54:25.442518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683628+0000","last_change":"2023-10-06T03:53:44.663208+0000","last_active":"2023-10-06T03:54:54.683628+0000","last_peered":"2023-10-06T03:54:54.683628+0000","last_clean":"2023-10-06T03:54:54.683628+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:54:54.683628+0000","last_undegraded":"2023-10-06T03:54:54.683628+0000","last_fullsized":"2023-10-06T03:54:54.683628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511118+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:54:27.511118+0000","last_peered":"2023-10-06T03:54:27.511118+0000","last_clean":"2023-10-06T03:54:27.511118+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:54:27.511118+0000","last_undegraded":"2023-10-06T03:54:27.511118+0000","last_fullsized":"2023-10-06T03:54:27.511118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442576+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:54:25.442576+0000","last_peered":"2023-10-06T03:54:25.442576+0000","last_clean":"2023-10-06T03:54:25.442576+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:54:25.442576+0000","last_undegraded":"2023-10-06T03:54:25.442576+0000","last_fullsized":"2023-10-06T03:54:25.442576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.681999+0000","last_change":"2023-10-06T03:53:44.659297+0000","last_active":"2023-10-06T03:54:54.681999+0000","last_peered":"2023-10-06T03:54:54.681999+0000","last_clean":"2023-10-06T03:54:54.681999+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:54:54.681999+0000","last_undegraded":"2023-10-06T03:54:54.681999+0000","last_fullsized":"2023-10-06T03:54:54.681999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441963+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:54:25.441963+0000","last_peered":"2023-10-06T03:54:25.441963+0000","last_clean":"2023-10-06T03:54:25.441963+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:54:25.441963+0000","last_undegraded":"2023-10-06T03:54:25.441963+0000","last_fullsized":"2023-10-06T03:54:25.441963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'9","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.659454+0000","last_change":"2023-10-06T03:53:44.661812+0000","last_active":"2023-10-06T03:54:54.659454+0000","last_peered":"2023-10-06T03:54:54.659454+0000","last_clean":"2023-10-06T03:54:54.659454+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:54:54.659454+0000","last_undegraded":"2023-10-06T03:54:54.659454+0000","last_fullsized":"2023-10-06T03:54:54.659454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442071+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:54:25.442071+0000","last_peered":"2023-10-06T03:54:25.442071+0000","last_clean":"2023-10-06T03:54:25.442071+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:54:25.442071+0000","last_undegraded":"2023-10-06T03:54:25.442071+0000","last_fullsized":"2023-10-06T03:54:25.442071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'19","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686059+0000","last_change":"2023-10-06T03:53:44.663448+0000","last_active":"2023-10-06T03:54:54.686059+0000","last_peered":"2023-10-06T03:54:54.686059+0000","last_clean":"2023-10-06T03:54:54.686059+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:54:54.686059+0000","last_undegraded":"2023-10-06T03:54:54.686059+0000","last_fullsized":"2023-10-06T03:54:54.686059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322645+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:54:26.322645+0000","last_peered":"2023-10-06T03:54:26.322645+0000","last_clean":"2023-10-06T03:54:26.322645+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:54:26.322645+0000","last_undegraded":"2023-10-06T03:54:26.322645+0000","last_fullsized":"2023-10-06T03:54:26.322645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'29","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693248+0000","last_change":"2023-10-06T03:53:44.664065+0000","last_active":"2023-10-06T03:54:54.693248+0000","last_peered":"2023-10-06T03:54:54.693248+0000","last_clean":"2023-10-06T03:54:54.693248+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:54:54.693248+0000","last_undegraded":"2023-10-06T03:54:54.693248+0000","last_fullsized":"2023-10-06T03:54:54.693248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318742+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:54:26.318742+0000","last_peered":"2023-10-06T03:54:26.318742+0000","last_clean":"2023-10-06T03:54:26.318742+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:54:26.318742+0000","last_undegraded":"2023-10-06T03:54:26.318742+0000","last_fullsized":"2023-10-06T03:54:26.318742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.684017+0000","last_change":"2023-10-06T03:53:44.658913+0000","last_active":"2023-10-06T03:54:54.684017+0000","last_peered":"2023-10-06T03:54:54.684017+0000","last_clean":"2023-10-06T03:54:54.684017+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:54:54.684017+0000","last_undegraded":"2023-10-06T03:54:54.684017+0000","last_fullsized":"2023-10-06T03:54:54.684017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511337+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:54:27.511337+0000","last_peered":"2023-10-06T03:54:27.511337+0000","last_clean":"2023-10-06T03:54:27.511337+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:54:27.511337+0000","last_undegraded":"2023-10-06T03:54:27.511337+0000","last_fullsized":"2023-10-06T03:54:27.511337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691133+0000","last_change":"2023-10-06T03:53:44.664132+0000","last_active":"2023-10-06T03:54:54.691133+0000","last_peered":"2023-10-06T03:54:54.691133+0000","last_clean":"2023-10-06T03:54:54.691133+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:54:54.691133+0000","last_undegraded":"2023-10-06T03:54:54.691133+0000","last_fullsized":"2023-10-06T03:54:54.691133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307450+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:54:25.307450+0000","last_peered":"2023-10-06T03:54:25.307450+0000","last_clean":"2023-10-06T03:54:25.307450+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:54:25.307450+0000","last_undegraded":"2023-10-06T03:54:25.307450+0000","last_fullsized":"2023-10-06T03:54:25.307450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'17","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683144+0000","last_change":"2023-10-06T03:53:44.664300+0000","last_active":"2023-10-06T03:54:54.683144+0000","last_peered":"2023-10-06T03:54:54.683144+0000","last_clean":"2023-10-06T03:54:54.683144+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:54:54.683144+0000","last_undegraded":"2023-10-06T03:54:54.683144+0000","last_fullsized":"2023-10-06T03:54:54.683144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318339+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:54:26.318339+0000","last_peered":"2023-10-06T03:54:26.318339+0000","last_clean":"2023-10-06T03:54:26.318339+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:54:26.318339+0000","last_undegraded":"2023-10-06T03:54:26.318339+0000","last_fullsized":"2023-10-06T03:54:26.318339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687775+0000","last_change":"2023-10-06T03:53:44.670493+0000","last_active":"2023-10-06T03:54:54.687775+0000","last_peered":"2023-10-06T03:54:54.687775+0000","last_clean":"2023-10-06T03:54:54.687775+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:54:54.687775+0000","last_undegraded":"2023-10-06T03:54:54.687775+0000","last_fullsized":"2023-10-06T03:54:54.687775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441398+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:54:25.441398+0000","last_peered":"2023-10-06T03:54:25.441398+0000","last_clean":"2023-10-06T03:54:25.441398+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:54:25.441398+0000","last_undegraded":"2023-10-06T03:54:25.441398+0000","last_fullsized":"2023-10-06T03:54:25.441398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317159+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:54:25.317159+0000","last_peered":"2023-10-06T03:54:25.317159+0000","last_clean":"2023-10-06T03:54:25.317159+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:54:25.317159+0000","last_undegraded":"2023-10-06T03:54:25.317159+0000","last_fullsized":"2023-10-06T03:54:25.317159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.306186+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:54:25.306186+0000","last_peered":"2023-10-06T03:54:25.306186+0000","last_clean":"2023-10-06T03:54:25.306186+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:54:25.306186+0000","last_undegraded":"2023-10-06T03:54:25.306186+0000","last_fullsized":"2023-10-06T03:54:25.306186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'22","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683268+0000","last_change":"2023-10-06T03:53:44.661889+0000","last_active":"2023-10-06T03:54:54.683268+0000","last_peered":"2023-10-06T03:54:54.683268+0000","last_clean":"2023-10-06T03:54:54.683268+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:54:54.683268+0000","last_undegraded":"2023-10-06T03:54:54.683268+0000","last_fullsized":"2023-10-06T03:54:54.683268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.441157+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:54:25.441157+0000","last_peered":"2023-10-06T03:54:25.441157+0000","last_clean":"2023-10-06T03:54:25.441157+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:54:25.441157+0000","last_undegraded":"2023-10-06T03:54:25.441157+0000","last_fullsized":"2023-10-06T03:54:25.441157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.697685+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:54:54.697685+0000","last_peered":"2023-10-06T03:54:54.697685+0000","last_clean":"2023-10-06T03:54:54.697685+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:54:54.697685+0000","last_undegraded":"2023-10-06T03:54:54.697685+0000","last_fullsized":"2023-10-06T03:54:54.697685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4747,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":10,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693738+0000","last_change":"2023-10-06T03:53:44.662895+0000","last_active":"2023-10-06T03:54:54.693738+0000","last_peered":"2023-10-06T03:54:54.693738+0000","last_clean":"2023-10-06T03:54:54.693738+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:54:54.693738+0000","last_undegraded":"2023-10-06T03:54:54.693738+0000","last_fullsized":"2023-10-06T03:54:54.693738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.314504+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:54:25.314504+0000","last_peered":"2023-10-06T03:54:25.314504+0000","last_clean":"2023-10-06T03:54:25.314504+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:54:25.314504+0000","last_undegraded":"2023-10-06T03:54:25.314504+0000","last_fullsized":"2023-10-06T03:54:25.314504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.163355+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:54:27.163355+0000","last_peered":"2023-10-06T03:54:27.163355+0000","last_clean":"2023-10-06T03:54:27.163355+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:54:27.163355+0000","last_undegraded":"2023-10-06T03:54:27.163355+0000","last_fullsized":"2023-10-06T03:54:27.163355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686184+0000","last_change":"2023-10-06T03:53:44.659941+0000","last_active":"2023-10-06T03:54:54.686184+0000","last_peered":"2023-10-06T03:54:54.686184+0000","last_clean":"2023-10-06T03:54:54.686184+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:54:54.686184+0000","last_undegraded":"2023-10-06T03:54:54.686184+0000","last_fullsized":"2023-10-06T03:54:54.686184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317127+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:54:25.317127+0000","last_peered":"2023-10-06T03:54:25.317127+0000","last_clean":"2023-10-06T03:54:25.317127+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:54:25.317127+0000","last_undegraded":"2023-10-06T03:54:25.317127+0000","last_fullsized":"2023-10-06T03:54:25.317127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.308030+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:54:25.308030+0000","last_peered":"2023-10-06T03:54:25.308030+0000","last_clean":"2023-10-06T03:54:25.308030+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:54:25.308030+0000","last_undegraded":"2023-10-06T03:54:25.308030+0000","last_fullsized":"2023-10-06T03:54:25.308030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'26","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.680025+0000","last_change":"2023-10-06T03:54:26.783934+0000","last_active":"2023-10-06T03:54:54.680025+0000","last_peered":"2023-10-06T03:54:54.680025+0000","last_clean":"2023-10-06T03:54:54.680025+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:54:54.680025+0000","last_undegraded":"2023-10-06T03:54:54.680025+0000","last_fullsized":"2023-10-06T03:54:54.680025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:52.067892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.318195+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:54:25.318195+0000","last_peered":"2023-10-06T03:54:25.318195+0000","last_clean":"2023-10-06T03:54:25.318195+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:54:25.318195+0000","last_undegraded":"2023-10-06T03:54:25.318195+0000","last_fullsized":"2023-10-06T03:54:25.318195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321701+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:54:25.321701+0000","last_peered":"2023-10-06T03:54:25.321701+0000","last_clean":"2023-10-06T03:54:25.321701+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:54:25.321701+0000","last_undegraded":"2023-10-06T03:54:25.321701+0000","last_fullsized":"2023-10-06T03:54:25.321701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.685066+0000","last_change":"2023-10-06T03:53:44.660124+0000","last_active":"2023-10-06T03:54:54.685066+0000","last_peered":"2023-10-06T03:54:54.685066+0000","last_clean":"2023-10-06T03:54:54.685066+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:54:54.685066+0000","last_undegraded":"2023-10-06T03:54:54.685066+0000","last_fullsized":"2023-10-06T03:54:54.685066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321605+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:54:25.321605+0000","last_peered":"2023-10-06T03:54:25.321605+0000","last_clean":"2023-10-06T03:54:25.321605+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:54:25.321605+0000","last_undegraded":"2023-10-06T03:54:25.321605+0000","last_fullsized":"2023-10-06T03:54:25.321605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442307+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:54:25.442307+0000","last_peered":"2023-10-06T03:54:25.442307+0000","last_clean":"2023-10-06T03:54:25.442307+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:54:25.442307+0000","last_undegraded":"2023-10-06T03:54:25.442307+0000","last_fullsized":"2023-10-06T03:54:25.442307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'18","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682160+0000","last_change":"2023-10-06T03:53:44.663854+0000","last_active":"2023-10-06T03:54:54.682160+0000","last_peered":"2023-10-06T03:54:54.682160+0000","last_clean":"2023-10-06T03:54:54.682160+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:54:54.682160+0000","last_undegraded":"2023-10-06T03:54:54.682160+0000","last_fullsized":"2023-10-06T03:54:54.682160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318970+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:54:26.318970+0000","last_peered":"2023-10-06T03:54:26.318970+0000","last_clean":"2023-10-06T03:54:26.318970+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:54:26.318970+0000","last_undegraded":"2023-10-06T03:54:26.318970+0000","last_fullsized":"2023-10-06T03:54:26.318970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.321818+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:54:25.321818+0000","last_peered":"2023-10-06T03:54:25.321818+0000","last_clean":"2023-10-06T03:54:25.321818+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:54:25.321818+0000","last_undegraded":"2023-10-06T03:54:25.321818+0000","last_fullsized":"2023-10-06T03:54:25.321818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'30","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682334+0000","last_change":"2023-10-06T03:53:44.661587+0000","last_active":"2023-10-06T03:54:54.682334+0000","last_peered":"2023-10-06T03:54:54.682334+0000","last_clean":"2023-10-06T03:54:54.682334+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:54:54.682334+0000","last_undegraded":"2023-10-06T03:54:54.682334+0000","last_fullsized":"2023-10-06T03:54:54.682334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'4","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:49.597324+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:54:49.597324+0000","last_peered":"2023-10-06T03:54:49.597324+0000","last_clean":"2023-10-06T03:54:49.597324+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:54:49.597324+0000","last_undegraded":"2023-10-06T03:54:49.597324+0000","last_fullsized":"2023-10-06T03:54:49.597324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.442543+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:54:25.442543+0000","last_peered":"2023-10-06T03:54:25.442543+0000","last_clean":"2023-10-06T03:54:25.442543+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:54:25.442543+0000","last_undegraded":"2023-10-06T03:54:25.442543+0000","last_fullsized":"2023-10-06T03:54:25.442543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.690041+0000","last_change":"2023-10-06T03:53:44.651106+0000","last_active":"2023-10-06T03:54:54.690041+0000","last_peered":"2023-10-06T03:54:54.690041+0000","last_clean":"2023-10-06T03:54:54.690041+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:54:54.690041+0000","last_undegraded":"2023-10-06T03:54:54.690041+0000","last_fullsized":"2023-10-06T03:54:54.690041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'46","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691334+0000","last_change":"2023-10-06T03:53:44.659586+0000","last_active":"2023-10-06T03:54:54.691334+0000","last_peered":"2023-10-06T03:54:54.691334+0000","last_clean":"2023-10-06T03:54:54.691334+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:54:54.691334+0000","last_undegraded":"2023-10-06T03:54:54.691334+0000","last_fullsized":"2023-10-06T03:54:54.691334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'104","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:55.747782+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:54:55.747782+0000","last_peered":"2023-10-06T03:54:55.747782+0000","last_clean":"2023-10-06T03:54:55.747782+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:54:55.747782+0000","last_undegraded":"2023-10-06T03:54:55.747782+0000","last_fullsized":"2023-10-06T03:54:55.747782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407920,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.677320+0000","last_change":"2023-10-06T03:53:44.672455+0000","last_active":"2023-10-06T03:54:54.677320+0000","last_peered":"2023-10-06T03:54:54.677320+0000","last_clean":"2023-10-06T03:54:54.677320+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:54:54.677320+0000","last_undegraded":"2023-10-06T03:54:54.677320+0000","last_fullsized":"2023-10-06T03:54:54.677320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'11","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:53.707912+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:54:53.707912+0000","last_peered":"2023-10-06T03:54:53.707912+0000","last_clean":"2023-10-06T03:54:53.707912+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:54:53.707912+0000","last_undegraded":"2023-10-06T03:54:53.707912+0000","last_fullsized":"2023-10-06T03:54:53.707912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322868+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:54:26.322868+0000","last_peered":"2023-10-06T03:54:26.322868+0000","last_clean":"2023-10-06T03:54:26.322868+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:54:26.322868+0000","last_undegraded":"2023-10-06T03:54:26.322868+0000","last_fullsized":"2023-10-06T03:54:26.322868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.682370+0000","last_change":"2023-10-06T03:53:44.664680+0000","last_active":"2023-10-06T03:54:54.682370+0000","last_peered":"2023-10-06T03:54:54.682370+0000","last_clean":"2023-10-06T03:54:54.682370+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:54:54.682370+0000","last_undegraded":"2023-10-06T03:54:54.682370+0000","last_fullsized":"2023-10-06T03:54:54.682370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320410+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:54:26.320410+0000","last_peered":"2023-10-06T03:54:26.320410+0000","last_clean":"2023-10-06T03:54:26.320410+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:54:26.320410+0000","last_undegraded":"2023-10-06T03:54:26.320410+0000","last_fullsized":"2023-10-06T03:54:26.320410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'20","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692340+0000","last_change":"2023-10-06T03:53:44.669613+0000","last_active":"2023-10-06T03:54:54.692340+0000","last_peered":"2023-10-06T03:54:54.692340+0000","last_clean":"2023-10-06T03:54:54.692340+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:54:54.692340+0000","last_undegraded":"2023-10-06T03:54:54.692340+0000","last_fullsized":"2023-10-06T03:54:54.692340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.674969+0000","last_change":"2023-10-06T03:53:44.661979+0000","last_active":"2023-10-06T03:54:54.674969+0000","last_peered":"2023-10-06T03:54:54.674969+0000","last_clean":"2023-10-06T03:54:54.674969+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:54:54.674969+0000","last_undegraded":"2023-10-06T03:54:54.674969+0000","last_fullsized":"2023-10-06T03:54:54.674969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.305861+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:54:25.305861+0000","last_peered":"2023-10-06T03:54:25.305861+0000","last_clean":"2023-10-06T03:54:25.305861+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:54:25.305861+0000","last_undegraded":"2023-10-06T03:54:25.305861+0000","last_fullsized":"2023-10-06T03:54:25.305861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'15","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683307+0000","last_change":"2023-10-06T03:53:44.663603+0000","last_active":"2023-10-06T03:54:54.683307+0000","last_peered":"2023-10-06T03:54:54.683307+0000","last_clean":"2023-10-06T03:54:54.683307+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:54:54.683307+0000","last_undegraded":"2023-10-06T03:54:54.683307+0000","last_fullsized":"2023-10-06T03:54:54.683307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.702690+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:54:46.702690+0000","last_peered":"2023-10-06T03:54:46.702690+0000","last_clean":"2023-10-06T03:54:46.702690+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:54:46.702690+0000","last_undegraded":"2023-10-06T03:54:46.702690+0000","last_fullsized":"2023-10-06T03:54:46.702690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'38","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.693364+0000","last_change":"2023-10-06T03:53:44.661346+0000","last_active":"2023-10-06T03:54:54.693364+0000","last_peered":"2023-10-06T03:54:54.693364+0000","last_clean":"2023-10-06T03:54:54.693364+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:54:54.693364+0000","last_undegraded":"2023-10-06T03:54:54.693364+0000","last_fullsized":"2023-10-06T03:54:54.693364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.307756+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:54:25.307756+0000","last_peered":"2023-10-06T03:54:25.307756+0000","last_clean":"2023-10-06T03:54:25.307756+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:54:25.307756+0000","last_undegraded":"2023-10-06T03:54:25.307756+0000","last_fullsized":"2023-10-06T03:54:25.307756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'23","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.692904+0000","last_change":"2023-10-06T03:53:44.665657+0000","last_active":"2023-10-06T03:54:54.692904+0000","last_peered":"2023-10-06T03:54:54.692904+0000","last_clean":"2023-10-06T03:54:54.692904+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:54:54.692904+0000","last_undegraded":"2023-10-06T03:54:54.692904+0000","last_fullsized":"2023-10-06T03:54:54.692904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320056+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:54:26.320056+0000","last_peered":"2023-10-06T03:54:26.320056+0000","last_clean":"2023-10-06T03:54:26.320056+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:54:26.320056+0000","last_undegraded":"2023-10-06T03:54:26.320056+0000","last_fullsized":"2023-10-06T03:54:26.320056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.686775+0000","last_change":"2023-10-06T03:53:44.657238+0000","last_active":"2023-10-06T03:54:54.686775+0000","last_peered":"2023-10-06T03:54:54.686775+0000","last_clean":"2023-10-06T03:54:54.686775+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:54:54.686775+0000","last_undegraded":"2023-10-06T03:54:54.686775+0000","last_fullsized":"2023-10-06T03:54:54.686775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:54:25.317777+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:54:25.317777+0000","last_peered":"2023-10-06T03:54:25.317777+0000","last_clean":"2023-10-06T03:54:25.317777+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:54:25.317777+0000","last_undegraded":"2023-10-06T03:54:25.317777+0000","last_fullsized":"2023-10-06T03:54:25.317777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'26","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.691238+0000","last_change":"2023-10-06T03:53:44.657617+0000","last_active":"2023-10-06T03:54:54.691238+0000","last_peered":"2023-10-06T03:54:54.691238+0000","last_clean":"2023-10-06T03:54:54.691238+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:54:54.691238+0000","last_undegraded":"2023-10-06T03:54:54.691238+0000","last_fullsized":"2023-10-06T03:54:54.691238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322849+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:54:26.322849+0000","last_peered":"2023-10-06T03:54:26.322849+0000","last_clean":"2023-10-06T03:54:26.322849+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:54:26.322849+0000","last_undegraded":"2023-10-06T03:54:26.322849+0000","last_fullsized":"2023-10-06T03:54:26.322849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'27","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.687161+0000","last_change":"2023-10-06T03:53:44.656254+0000","last_active":"2023-10-06T03:54:54.687161+0000","last_peered":"2023-10-06T03:54:54.687161+0000","last_clean":"2023-10-06T03:54:54.687161+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:54:54.687161+0000","last_undegraded":"2023-10-06T03:54:54.687161+0000","last_fullsized":"2023-10-06T03:54:54.687161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318654+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:54:26.318654+0000","last_peered":"2023-10-06T03:54:26.318654+0000","last_clean":"2023-10-06T03:54:26.318654+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:54:26.318654+0000","last_undegraded":"2023-10-06T03:54:26.318654+0000","last_fullsized":"2023-10-06T03:54:26.318654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'25","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:54.683856+0000","last_change":"2023-10-06T03:53:44.664726+0000","last_active":"2023-10-06T03:54:54.683856+0000","last_peered":"2023-10-06T03:54:54.683856+0000","last_clean":"2023-10-06T03:54:54.683856+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:54:54.683856+0000","last_undegraded":"2023-10-06T03:54:54.683856+0000","last_fullsized":"2023-10-06T03:54:54.683856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.320336+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:54:26.320336+0000","last_peered":"2023-10-06T03:54:26.320336+0000","last_clean":"2023-10-06T03:54:26.320336+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:54:26.320336+0000","last_undegraded":"2023-10-06T03:54:26.320336+0000","last_fullsized":"2023-10-06T03:54:26.320336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":26,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1567,"ondisk_log_size":1567,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":413437,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":10,"num_read_kb":13,"num_write":165,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":892928,"data_stored":826874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542164,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":1100059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.046},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.0089999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.139}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.244}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.419},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.109}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.0740000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":109960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.141}]},{"osd":1,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.746},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1659999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.107}]},{"osd":7,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.085},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.0589999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.044}]},{"osd":1,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.999}]},{"osd":2,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.135}]},{"osd":4,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":1.161},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.206}]},{"osd":7,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.177}]}]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":720896,"data_stored":514291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.288}]},{"osd":5,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.871},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.026}]},{"osd":6,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.151}]},{"osd":7,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.131},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.4770000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542165,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.432},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.92400000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.94799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":1.151},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747}]},{"osd":1,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.96899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.079},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.321},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.002}]},{"osd":6,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.177},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.397}]},{"osd":7,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.29},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.246}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301668,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3280000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.997}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.091}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.4419999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":892928,"data_stored":705620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.113},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0129999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.5149999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":0.93999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":5301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":412723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":408136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:54:59.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:54:59.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 Processor -- start 2023-10-06T03:54:59.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 -- start start 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 0x7f76d806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d80b1620 0x7f76d8142150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76d8142690 0x7f76d80b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d806dd30 con 0x7f76d8142690 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d806ce50 con 0x7f76d806c540 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d806ecd0 con 0x7f76d80b1620 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76d8142690 0x7f76d80b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d659c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 0x7f76d806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.807 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76d8142690 0x7f76d80b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43084/0 (socket says 172.21.15.57:43084) 2023-10-06T03:54:59.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d5d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d80b1620 0x7f76d8142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.808 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 -- 172.21.15.57:0/3870672240 learned_addr learned my addr 172.21.15.57:0/3870672240 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 -- 172.21.15.57:0/3870672240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d80b1620 msgr2=0x7f76d8142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/3870672240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d80b1620 0x7f76d8142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 -- 172.21.15.57:0/3870672240 >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 msgr2=0x7f76d806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/3870672240 >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 0x7f76d806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 -- 172.21.15.57:0/3870672240 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d806efb0 con 0x7f76d8142690 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d659c700 1 --2- 172.21.15.57:0/3870672240 >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 0x7f76d806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/3870672240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8142690 0x7f76d80b05d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b0320 tx=0x7f76d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557626b129f5206c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d559a700 1 -- 172.21.15.57:0/3870672240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011630 con 0x7f76d8142690 2023-10-06T03:54:59.809 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d559a700 1 -- 172.21.15.57:0/3870672240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d0011790 con 0x7f76d8142690 2023-10-06T03:54:59.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.803+0000 7f76d559a700 1 -- 172.21.15.57:0/3870672240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011b30 con 0x7f76d8142690 2023-10-06T03:54:59.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- 172.21.15.57:0/3870672240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8142690 msgr2=0x7f76d80b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.810 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- 172.21.15.57:0/3870672240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8142690 0x7f76d80b05d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f76d80b0320 tx=0x7f76d0009250 comp rx=0 tx=0).stop 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- 172.21.15.57:0/3870672240 shutdown_connections 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- 172.21.15.57:0/3870672240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8142690 0x7f76d80b05d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- 172.21.15.57:0/3870672240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d80b1620 0x7f76d8142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- 172.21.15.57:0/3870672240 >> v2:172.21.15.105:3300/0 conn(0x7f76d806c540 0x7f76d806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- 172.21.15.57:0/3870672240 >> 172.21.15.57:0/3870672240 conn(0x7f76d80b1a00 msgr2=0x7f76d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- 172.21.15.57:0/3870672240 shutdown_connections 2023-10-06T03:54:59.811 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- 172.21.15.57:0/3870672240 wait complete. 2023-10-06T03:54:59.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 Processor -- start 2023-10-06T03:54:59.812 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 -- start start 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d806c540 0x7f76d80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.807+0000 7f76d759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d8142690 0x7f76d8151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d813bb00 con 0x7f76d8151e80 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d8152320 con 0x7f76d806c540 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80adaf0 con 0x7f76d8142690 2023-10-06T03:54:59.813 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43098/0 (socket says 172.21.15.57:43098) 2023-10-06T03:54:59.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 -- 172.21.15.57:0/1990472155 learned_addr learned my addr 172.21.15.57:0/1990472155 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:54:59.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d659c700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d806c540 0x7f76d80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.814 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d5d9b700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d8142690 0x7f76d8151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 -- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d8142690 msgr2=0x7f76d8151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d8142690 0x7f76d8151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 -- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d806c540 msgr2=0x7f76d80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d806c540 0x7f76d80ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 -- 172.21.15.57:0/1990472155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8009a20 con 0x7f76d8151e80 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d6d9d700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76d00099e0 tx=0x7f76d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.815 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0011b10 con 0x7f76d8151e80 2023-10-06T03:54:59.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d00233f0 con 0x7f76d8151e80 2023-10-06T03:54:59.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d00094f0 con 0x7f76d8151e80 2023-10-06T03:54:59.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0023790 con 0x7f76d8151e80 2023-10-06T03:54:59.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d80ad810 con 0x7f76d8151e80 2023-10-06T03:54:59.816 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.811+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d80adef0 con 0x7f76d8151e80 2023-10-06T03:54:59.817 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.815+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f76d00193b0 con 0x7f76d8151e80 2023-10-06T03:54:59.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.815+0000 7f76ce7fc700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 0x7f76bc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:54:59.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.815+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f76d007dee0 con 0x7f76d8151e80 2023-10-06T03:54:59.818 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.815+0000 7f76d659c700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 0x7f76bc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:54:59.819 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.815+0000 7f76d659c700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 0x7f76bc062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009fd0 tx=0x7f76c800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:54:59.825 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.823+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f76d004e310 con 0x7f76d8151e80 2023-10-06T03:54:59.986 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.983+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76d8141c30 con 0x7f76d8151e80 2023-10-06T03:54:59.988 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.983+0000 7f76ce7fc700 1 -- 172.21.15.57:0/1990472155 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f76d0051930 con 0x7f76d8151e80 2023-10-06T03:54:59.988 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:54:59.989 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":27,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:54:26.303170+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 msgr2=0x7f76bc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 0x7f76bc062a00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009fd0 tx=0x7f76c800b040 comp rx=0 tx=0).stop 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 msgr2=0x7f76d8154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76d00099e0 tx=0x7f76d0017000 comp rx=0 tx=0).stop 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 shutdown_connections 2023-10-06T03:54:59.991 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f76bc060550 0x7f76bc062a00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76d8151e80 0x7f76d8154b80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d8142690 0x7f76d8151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 --2- 172.21.15.57:0/1990472155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d806c540 0x7f76d80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 >> 172.21.15.57:0/1990472155 conn(0x7f76d80b1a00 msgr2=0x7f76d813ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 shutdown_connections 2023-10-06T03:54:59.992 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:54:59.987+0000 7f76d759e700 1 -- 172.21.15.57:0/1990472155 wait complete. 2023-10-06T03:55:01.004 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:55:01.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:01.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.123+0000 7f93a9346700 1 Processor -- start 2023-10-06T03:55:01.128 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.123+0000 7f93a9346700 1 -- start start 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a9346700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a41426d0 0x7f93a4142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a9346700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a413c950 con 0x7f93a413be00 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a9346700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40b35e0 con 0x7f93a40b6b10 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a9346700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40b3000 con 0x7f93a41426d0 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a8b45700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93a413be00 0x7f93a413c240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45218/0 (socket says 172.21.15.57:45218) 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a8b45700 1 -- 172.21.15.57:0/1667107019 learned_addr learned my addr 172.21.15.57:0/1667107019 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:01.130 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a37fe700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a41426d0 0x7f93a4142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623146093 0 0) 0x7f939c001490 con 0x7f93a413be00 2023-10-06T03:55:01.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9390003570 con 0x7f93a413be00 2023-10-06T03:55:01.133 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600706976 0 0) 0x7f93a40b35e0 con 0x7f93a40b6b10 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c001490 con 0x7f93a40b6b10 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665022441 0 0) 0x7f9390003570 con 0x7f93a413be00 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a41426d0 msgr2=0x7f93a4142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a41426d0 0x7f93a4142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 >> v1:172.21.15.105:6789/0 conn(0x7f93a40b6b10 legacy=0x7f93a40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40b4180 con 0x7f93a413be00 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f939c001980 con 0x7f93a413be00 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 >> v1:172.21.15.57:6789/0 conn(0x7f93a413be00 legacy=0x7f93a413c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9390003c20 0x7f9390004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9390004810 0x7f9390004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.134 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93900051c0 0x7f939000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40b3000 con 0x7f9390003c20 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939000c0b0 con 0x7f9390004810 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939000c270 con 0x7f93900051c0 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a37fe700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a41426d0 0x7f93a4142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9390003c20 0x7f9390004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a8b45700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93900051c0 0x7f939000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a37fe700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9390004810 0x7f9390004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 -- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93900051c0 msgr2=0x7f939000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93900051c0 0x7f939000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.135 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 -- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9390004810 msgr2=0x7f9390004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9390004810 0x7f9390004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a3fff700 1 -- 172.21.15.57:0/1667107019 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390003570 con 0x7f9390003c20 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.127+0000 7f93a37fe700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9390004810 0x7f9390004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a3fff700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9390003c20 0x7f9390004010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9394001a10 tx=0x7f9394007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c266c26cc73510c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939400c5d0 con 0x7f9390003c20 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939400c730 con 0x7f9390003c20 2023-10-06T03:55:01.136 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a2ffd700 1 -- 172.21.15.57:0/1667107019 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939400caf0 con 0x7f9390003c20 2023-10-06T03:55:01.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- 172.21.15.57:0/1667107019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9390003c20 msgr2=0x7f9390004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 --2- 172.21.15.57:0/1667107019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9390003c20 0x7f9390004010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9394001a10 tx=0x7f9394007d10 comp rx=0 tx=0).stop 2023-10-06T03:55:01.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a8b45700 1 -- 172.21.15.57:0/1667107019 reap_dead start 2023-10-06T03:55:01.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- 172.21.15.57:0/1667107019 shutdown_connections 2023-10-06T03:55:01.140 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- 172.21.15.57:0/1667107019 >> 172.21.15.57:0/1667107019 conn(0x7f93a406ddf0 msgr2=0x7f93a406e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- 172.21.15.57:0/1667107019 shutdown_connections 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- 172.21.15.57:0/1667107019 wait complete. 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 Processor -- start 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.131+0000 7f93a9346700 1 -- start start 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a413e8d0 0x7f93a413d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 0x7f93a413ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.141 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93a413eca0 0x7f93a4151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41552c0 con 0x7f93a4143340 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4155b60 con 0x7f93a413eca0 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4143810 con 0x7f93a413e8d0 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 0x7f93a413ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 0x7f93a413ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41626/0 (socket says 172.21.15.57:41626) 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 -- 172.21.15.57:0/3632392254 learned_addr learned my addr 172.21.15.57:0/3632392254 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a3fff700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a413e8d0 0x7f93a413d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.142 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a8b45700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93a413eca0 0x7f93a4151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 -- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a413e8d0 msgr2=0x7f93a413d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93a413e8d0 0x7f93a413d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 -- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93a413eca0 msgr2=0x7f93a4151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93a413eca0 0x7f93a4151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4155510 con 0x7f93a4143340 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a37fe700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 0x7f93a413ddd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f938c0119c0 tx=0x7f938c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00f700 con 0x7f93a4143340 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00f860 con 0x7f93a4143340 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a41557f0 con 0x7f93a4143340 2023-10-06T03:55:01.143 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00fbe0 con 0x7f93a4143340 2023-10-06T03:55:01.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a40b0ad0 con 0x7f93a4143340 2023-10-06T03:55:01.144 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.135+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93a4156190 con 0x7f93a4143340 2023-10-06T03:55:01.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f938c015460 con 0x7f93a4143340 2023-10-06T03:55:01.146 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9384060580 0x7f9384062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f938c07d470 con 0x7f93a4143340 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f9384068f30 0x7f938406b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f938406ba70 con 0x7f9384068f30 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f938c07d840 con 0x7f93a4143340 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f93a3fff700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9384060580 0x7f9384062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.147 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f93a8b45700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f9384068f30 0x7f938406b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f93a8b45700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f9384068f30 0x7f938406b3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f93a3fff700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9384060580 0x7f9384062a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93a41391f0 tx=0x7f9394015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.148 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.139+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== osd.0 v2:172.21.15.57:6816/33351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f938406ba70 con 0x7f9384068f30 2023-10-06T03:55:01.159 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 --> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93a406d8f0 con 0x7f9384068f30 2023-10-06T03:55:01.160 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f939bfff700 1 -- 172.21.15.57:0/3632392254 <== osd.0 v2:172.21.15.57:6816/33351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f93a406d8f0 con 0x7f9384068f30 2023-10-06T03:55:01.160 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:01.160 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:01.160 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:01.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f9384068f30 msgr2=0x7f938406b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.161 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:6816/33351,v1:172.21.15.57:6817/33351] conn(0x7f9384068f30 0x7f938406b3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9384060580 msgr2=0x7f9384062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f9384060580 0x7f9384062a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f93a41391f0 tx=0x7f9394015000 comp rx=0 tx=0).stop 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 msgr2=0x7f93a413ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a9346700 1 --2- 172.21.15.57:0/3632392254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a4143340 0x7f93a413ddd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f938c0119c0 tx=0x7f938c008040 comp rx=0 tx=0).stop 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.155+0000 7f93a8b45700 1 -- 172.21.15.57:0/3632392254 reap_dead start 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.159+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 shutdown_connections 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.159+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 >> 172.21.15.57:0/3632392254 conn(0x7f93a406ddf0 msgr2=0x7f93a4068cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.159+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 shutdown_connections 2023-10-06T03:55:01.162 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.159+0000 7f93a9346700 1 -- 172.21.15.57:0/3632392254 wait complete. 2023-10-06T03:55:01.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:55:01.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.283+0000 7f7bee199700 1 Processor -- start 2023-10-06T03:55:01.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.283+0000 7f7bee199700 1 -- start start 2023-10-06T03:55:01.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7be80b2bd0 0x7f7be80b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80b4b90 con 0x7f7be8067440 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80b00f0 con 0x7f7be8067070 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8143250 con 0x7f7be80b2bd0 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bec996700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7be8067440 0x7f7be8145ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45226/0 (socket says 172.21.15.57:45226) 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bec996700 1 -- 172.21.15.57:0/1043085715 learned_addr learned my addr 172.21.15.57:0/1043085715 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 --2- 172.21.15.57:0/1043085715 >> v2:172.21.15.105:3300/0 conn(0x7f7be80b2bd0 0x7f7be80b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052522384 0 0) 0x7f7be80b4b90 con 0x7f7be8067440 2023-10-06T03:55:01.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd4003570 con 0x7f7be8067440 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766914042 0 0) 0x7f7be80b00f0 con 0x7f7be8067070 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be80b4b90 con 0x7f7be8067070 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1081429585 0 0) 0x7f7bd4003570 con 0x7f7be8067440 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 >> v2:172.21.15.105:3300/0 conn(0x7f7be80b2bd0 msgr2=0x7f7be80b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 --2- 172.21.15.57:0/1043085715 >> v2:172.21.15.105:3300/0 conn(0x7f7be80b2bd0 0x7f7be80b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 >> v1:172.21.15.105:6789/0 conn(0x7f7be8067070 legacy=0x7f7be81457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.293 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be81465e0 con 0x7f7be8067440 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f7bd8001470 con 0x7f7be8067440 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 >> v1:172.21.15.57:6789/0 conn(0x7f7be8067440 legacy=0x7f7be8145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4003bf0 0x7f7bd4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd4004810 0x7f7bd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7bd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8143250 con 0x7f7bd4003bf0 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd400c200 con 0x7f7bd4004810 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd400c3c0 con 0x7f7bd4005230 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bec996700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd4004810 0x7f7bd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7bd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.294 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed197700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4003bf0 0x7f7bd4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 -- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd4004810 msgr2=0x7f7bd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd4004810 0x7f7bd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 -- 172.21.15.57:0/1043085715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4003bf0 msgr2=0x7f7bd4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4003bf0 0x7f7bd4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 -- 172.21.15.57:0/1043085715 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4003570 con 0x7f7bd4005230 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bec996700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bd4004810 0x7f7bd4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed197700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4003bf0 0x7f7bd4003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 -- 172.21.15.57:0/1043085715 reap_dead start 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bed998700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7bd400ba60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7be000e210 tx=0x7f7be000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15873c036ccd7b3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000eac0 con 0x7f7bd4005230 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be000f040 con 0x7f7bd4005230 2023-10-06T03:55:01.295 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bdffff700 1 -- 172.21.15.57:0/1043085715 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be000ee70 con 0x7f7bd4005230 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 msgr2=0x7f7bd400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7bd400ba60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7be000e210 tx=0x7f7be000b040 comp rx=0 tx=0).stop 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- 172.21.15.57:0/1043085715 shutdown_connections 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 --2- 172.21.15.57:0/1043085715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7bd400ba60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- 172.21.15.57:0/1043085715 >> 172.21.15.57:0/1043085715 conn(0x7f7be80b8b80 msgr2=0x7f7be80b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.287+0000 7f7bee199700 1 -- 172.21.15.57:0/1043085715 shutdown_connections 2023-10-06T03:55:01.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 -- 172.21.15.57:0/1043085715 wait complete. 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 Processor -- start 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 -- start start 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7be813cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be8155370 0x7f7be81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be813d280 con 0x7f7be80ae8d0 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be813e080 con 0x7f7be8155370 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bee199700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be813f490 con 0x7f7bd4005230 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed197700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7be813cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bec996700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be8155370 0x7f7be81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.299 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41652/0 (socket says 172.21.15.57:41652) 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed197700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7be813cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:54924/0 (socket says 172.21.15.57:54924) 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 -- 172.21.15.57:0/2223239613 learned_addr learned my addr 172.21.15.57:0/2223239613 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 -- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 msgr2=0x7f7be813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7be813cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 -- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be8155370 msgr2=0x7f7be81557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be8155370 0x7f7be81557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 -- 172.21.15.57:0/2223239613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be813da90 con 0x7f7be80ae8d0 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.291+0000 7f7bed998700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7be80875d0 tx=0x7f7be0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0009410 con 0x7f7be80ae8d0 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be001e670 con 0x7f7be80ae8d0 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be001ea30 con 0x7f7be80ae8d0 2023-10-06T03:55:01.300 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be8155d20 con 0x7f7be80ae8d0 2023-10-06T03:55:01.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be80af280 con 0x7f7be80ae8d0 2023-10-06T03:55:01.301 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be813deb0 con 0x7f7be80ae8d0 2023-10-06T03:55:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7be0003020 con 0x7f7be80ae8d0 2023-10-06T03:55:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 0x7f7bcc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f7be007ec60 con 0x7f7be80ae8d0 2023-10-06T03:55:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bed197700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 0x7f7bcc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.302 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.295+0000 7f7bed197700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 0x7f7bcc062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007e40 tx=0x7f7be4007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.303+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7be004f140 con 0x7f7be80ae8d0 2023-10-06T03:55:01.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.463+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7be806a090 con 0x7f7bcc060550 2023-10-06T03:55:01.470 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bdd7fa700 1 -- 172.21.15.57:0/2223239613 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7be806a090 con 0x7f7bcc060550 2023-10-06T03:55:01.471 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 msgr2=0x7f7bcc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 0x7f7bcc062a00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7be4007e40 tx=0x7f7be4007d30 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 msgr2=0x7f7be80aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7be80875d0 tx=0x7f7be0019000 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 shutdown_connections 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7bcc060550 0x7f7bcc062a00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7be80ae8d0 0x7f7be80aed40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be8155370 0x7f7be81557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 --2- 172.21.15.57:0/2223239613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bd4005230 0x7f7be813cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 >> 172.21.15.57:0/2223239613 conn(0x7f7be80b8b80 msgr2=0x7f7be80b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.472 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 shutdown_connections 2023-10-06T03:55:01.473 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.467+0000 7f7bee199700 1 -- 172.21.15.57:0/2223239613 wait complete. 2023-10-06T03:55:01.473 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:55:01.485 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:55:01.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:01.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.591+0000 7fc7091e4700 1 Processor -- start 2023-10-06T03:55:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.591+0000 7fc7091e4700 1 -- start start 2023-10-06T03:55:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc704069650 0x7fc70406be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc70406c340 0x7fc70414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7041461c0 con 0x7fc7040b74e0 2023-10-06T03:55:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc704142b60 con 0x7fc70406c340 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc704068990 con 0x7fc704069650 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc70406c340 0x7fc70414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc70406c340 0x7fc70414cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41660/0 (socket says 172.21.15.57:41660) 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 -- 172.21.15.57:0/3018901740 learned_addr learned my addr 172.21.15.57:0/3018901740 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc702d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7040b74e0 0x7fc704142450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45230/0 (socket says 172.21.15.57:45230) 2023-10-06T03:55:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc6fa59c700 1 --2- 172.21.15.57:0/3018901740 >> v2:172.21.15.105:3300/0 conn(0x7fc704069650 0x7fc70406be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 -- 172.21.15.57:0/3018901740 >> v2:172.21.15.105:3300/0 conn(0x7fc704069650 msgr2=0x7fc70406be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 --2- 172.21.15.57:0/3018901740 >> v2:172.21.15.105:3300/0 conn(0x7fc704069650 0x7fc70406be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 -- 172.21.15.57:0/3018901740 >> v1:172.21.15.57:6789/0 conn(0x7fc7040b74e0 legacy=0x7fc704142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 -- 172.21.15.57:0/3018901740 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704145b70 con 0x7fc70406c340 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70359e700 1 --2- 172.21.15.57:0/3018901740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70406c340 0x7fc70414cd10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b6b70 tx=0x7fc6fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c722c8765cbfd90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70259c700 1 -- 172.21.15.57:0/3018901740 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00e070 con 0x7fc70406c340 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70259c700 1 -- 172.21.15.57:0/3018901740 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00ba20 con 0x7fc70406c340 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc70259c700 1 -- 172.21.15.57:0/3018901740 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0092e0 con 0x7fc70406c340 2023-10-06T03:55:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- 172.21.15.57:0/3018901740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70406c340 msgr2=0x7fc70414cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3018901740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70406c340 0x7fc70414cd10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b6b70 tx=0x7fc6fc009840 comp rx=0 tx=0).stop 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- 172.21.15.57:0/3018901740 shutdown_connections 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3018901740 >> v2:172.21.15.105:3300/0 conn(0x7fc704069650 0x7fc70406be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3018901740 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70406c340 0x7fc70414cd10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- 172.21.15.57:0/3018901740 >> 172.21.15.57:0/3018901740 conn(0x7fc704067b40 msgr2=0x7fc7040b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- 172.21.15.57:0/3018901740 shutdown_connections 2023-10-06T03:55:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.595+0000 7fc7091e4700 1 -- 172.21.15.57:0/3018901740 wait complete. 2023-10-06T03:55:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 Processor -- start 2023-10-06T03:55:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 -- start start 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc704069650 0x7fc70413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70406c340 0x7fc7041528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 0x7fc704138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040afa80 con 0x7fc7040b74e0 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040addc0 con 0x7fc70406c340 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc7091e4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b0fc0 con 0x7fc704069650 2023-10-06T03:55:01.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 0x7fc704138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 0x7fc704138df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41662/0 (socket says 172.21.15.57:41662) 2023-10-06T03:55:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 -- 172.21.15.57:0/3422587713 learned_addr learned my addr 172.21.15.57:0/3422587713 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc702d9d700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc704069650 0x7fc70413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc6fa59c700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70406c340 0x7fc7041528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 -- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc704069650 msgr2=0x7fc70413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc704069650 0x7fc70413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 -- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70406c340 msgr2=0x7fc7041528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70406c340 0x7fc7041528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.599+0000 7fc70359e700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6fc009ae0 con 0x7fc7040b74e0 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc70359e700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 0x7fc704138df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc704068050 tx=0x7fc6fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0089b0 con 0x7fc7040b74e0 2023-10-06T03:55:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc008b10 con 0x7fc7040b74e0 2023-10-06T03:55:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7040afc80 con 0x7fc7040b74e0 2023-10-06T03:55:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc026460 con 0x7fc7040b74e0 2023-10-06T03:55:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7040b0d90 con 0x7fc7040b74e0 2023-10-06T03:55:01.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc70404be00 con 0x7fc7040b74e0 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.603+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc6fc003040 con 0x7fc7040b74e0 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc6e8060580 0x7fc6e8062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7fc6fc07e740 con 0x7fc7040b74e0 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc702d9d700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc6e8060580 0x7fc6e8062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7fc6e8068fb0 0x7fc6e806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6e806baf0 con 0x7fc6e8068fb0 2023-10-06T03:55:01.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6fc080d50 con 0x7fc7040b74e0 2023-10-06T03:55:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fa59c700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7fc6e8068fb0 0x7fc6e806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc702d9d700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc6e8060580 0x7fc6e8062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec004fd0 tx=0x7fc6ec007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fa59c700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7fc6e8068fb0 0x7fc6e806b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.607+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== osd.1 v2:172.21.15.57:6818/33352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc6e806baf0 con 0x7fc6e8068fb0 2023-10-06T03:55:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 --> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc704152230 con 0x7fc6e8068fb0 2023-10-06T03:55:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc6fb7fe700 1 -- 172.21.15.57:0/3422587713 <== osd.1 v2:172.21.15.57:6818/33352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc704152230 con 0x7fc6e8068fb0 2023-10-06T03:55:01.626 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:01.626 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7fc6e8068fb0 msgr2=0x7fc6e806b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:6818/33352,v1:172.21.15.57:6820/33352] conn(0x7fc6e8068fb0 0x7fc6e806b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc6e8060580 msgr2=0x7fc6e8062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc6e8060580 0x7fc6e8062a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec004fd0 tx=0x7fc6ec007eb0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 msgr2=0x7fc704138df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 --2- 172.21.15.57:0/3422587713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7040b74e0 0x7fc704138df0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc704068050 tx=0x7fc6fc018000 comp rx=0 tx=0).stop 2023-10-06T03:55:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc70359e700 1 -- 172.21.15.57:0/3422587713 reap_dead start 2023-10-06T03:55:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 shutdown_connections 2023-10-06T03:55:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 >> 172.21.15.57:0/3422587713 conn(0x7fc704067b40 msgr2=0x7fc7040b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 shutdown_connections 2023-10-06T03:55:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.623+0000 7fc7091e4700 1 -- 172.21.15.57:0/3422587713 wait complete. 2023-10-06T03:55:01.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:55:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 Processor -- start 2023-10-06T03:55:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 -- start start 2023-10-06T03:55:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 0x7fc94c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc94c0b2bd0 0x7fc94c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0b4b90 con 0x7fc94c067070 2023-10-06T03:55:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c143250 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.752 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0b00f0 con 0x7fc94c067440 2023-10-06T03:55:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94a59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc94c067070 0x7fc94c1457c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45232/0 (socket says 172.21.15.57:45232) 2023-10-06T03:55:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94a59c700 1 -- 172.21.15.57:0/2613303130 learned_addr learned my addr 172.21.15.57:0/2613303130 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc949d9b700 1 --2- 172.21.15.57:0/2613303130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 0x7fc94c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94ad9d700 1 --2- 172.21.15.57:0/2613303130 >> v2:172.21.15.105:3300/0 conn(0x7fc94c0b2bd0 0x7fc94c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94959a700 1 -- 172.21.15.57:0/2613303130 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551767736 0 0) 0x7fc94c0b4b90 con 0x7fc94c067070 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc94959a700 1 -- 172.21.15.57:0/2613303130 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc938003570 con 0x7fc94c067070 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc949d9b700 1 -- 172.21.15.57:0/2613303130 >> v2:172.21.15.105:3300/0 conn(0x7fc94c0b2bd0 msgr2=0x7fc94c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc949d9b700 1 --2- 172.21.15.57:0/2613303130 >> v2:172.21.15.105:3300/0 conn(0x7fc94c0b2bd0 0x7fc94c0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc949d9b700 1 -- 172.21.15.57:0/2613303130 >> v1:172.21.15.57:6789/0 conn(0x7fc94c067070 legacy=0x7fc94c1457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.747+0000 7fc949d9b700 1 -- 172.21.15.57:0/2613303130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0b0eb0 con 0x7fc94c067440 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc949d9b700 1 --2- 172.21.15.57:0/2613303130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 0x7fc94c0b5020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9340098e0 tx=0x7fc9340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac29bc001f4715c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94959a700 1 -- 172.21.15.57:0/2613303130 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934011630 con 0x7fc94c067440 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94959a700 1 -- 172.21.15.57:0/2613303130 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934011790 con 0x7fc94c067440 2023-10-06T03:55:01.755 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94959a700 1 -- 172.21.15.57:0/2613303130 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934011b30 con 0x7fc94c067440 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 -- 172.21.15.57:0/2613303130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 msgr2=0x7fc94c0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 --2- 172.21.15.57:0/2613303130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 0x7fc94c0b5020 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9340098e0 tx=0x7fc9340091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 -- 172.21.15.57:0/2613303130 shutdown_connections 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 --2- 172.21.15.57:0/2613303130 >> v2:172.21.15.105:3300/0 conn(0x7fc94c0b2bd0 0x7fc94c0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 --2- 172.21.15.57:0/2613303130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067440 0x7fc94c0b5020 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 -- 172.21.15.57:0/2613303130 >> 172.21.15.57:0/2613303130 conn(0x7fc94c0b8b80 msgr2=0x7fc94c0b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 -- 172.21.15.57:0/2613303130 shutdown_connections 2023-10-06T03:55:01.756 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.751+0000 7fc94b59e700 1 -- 172.21.15.57:0/2613303130 wait complete. 2023-10-06T03:55:01.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 Processor -- start 2023-10-06T03:55:01.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 -- start start 2023-10-06T03:55:01.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 0x7fc94c13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 0x7fc94c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c13e900 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c153040 con 0x7fc94c067440 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1529f0 con 0x7fc94c067070 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41678/0 (socket says 172.21.15.57:41678) 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 -- 172.21.15.57:0/483785673 learned_addr learned my addr 172.21.15.57:0/483785673 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94a59c700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 0x7fc94c13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc949d9b700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 0x7fc94c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 -- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 msgr2=0x7fc94c13eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 0x7fc94c13eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 -- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 msgr2=0x7fc94c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 0x7fc94c155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 -- 172.21.15.57:0/483785673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009420 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc949d9b700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 0x7fc94c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94a59c700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 0x7fc94c13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94ad9d700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e90 tx=0x7fc94400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400cc20 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400f040 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.755+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c152cd0 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.759+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944014480 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.762 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.759+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c13fea0 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.759+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c06a090 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.763 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.759+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fc944014830 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.759+0000 7fc9427fc700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 0x7fc92c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.763+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7fc94407d420 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.763+0000 7fc94a59c700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 0x7fc92c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.763+0000 7fc94a59c700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 0x7fc92c062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0058d0 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:01.769 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.767+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc9440512d0 con 0x7fc94c0b2bd0 2023-10-06T03:55:01.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.927+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc94c145ed0 con 0x7fc92c060550 2023-10-06T03:55:01.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.927+0000 7fc9427fc700 1 -- 172.21.15.57:0/483785673 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc94c145ed0 con 0x7fc92c060550 2023-10-06T03:55:01.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 msgr2=0x7fc92c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 0x7fc92c062a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0058d0 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2023-10-06T03:55:01.963 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 msgr2=0x7fc94c155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e90 tx=0x7fc94400b040 comp rx=0 tx=0).stop 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 shutdown_connections 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fc92c060550 0x7fc92c062a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc94c0b2bd0 0x7fc94c155ed0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94c067440 0x7fc94c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 --2- 172.21.15.57:0/483785673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94c067070 0x7fc94c13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 >> 172.21.15.57:0/483785673 conn(0x7fc94c0b8b80 msgr2=0x7fc94c0b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 shutdown_connections 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:01.931+0000 7fc94b59e700 1 -- 172.21.15.57:0/483785673 wait complete. 2023-10-06T03:55:01.964 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:55:01.964 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:55:01.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:02.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 Processor -- start 2023-10-06T03:55:02.084 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 -- start start 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40aabc0 con 0x7fd8b41384b0 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b4141d80 con 0x7fd8b41421a0 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.079+0000 7fd8bb12e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40b18a0 con 0x7fd8b406a1e0 2023-10-06T03:55:02.085 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba92d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba92d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:44070/0 (socket says 172.21.15.57:44070) 2023-10-06T03:55:02.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba92d700 1 -- 172.21.15.57:0/3704683641 learned_addr learned my addr 172.21.15.57:0/3704683641 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:02.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:54954/0 (socket says 172.21.15.57:54954) 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 -- 172.21.15.57:0/3704683641 >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 msgr2=0x7fd8b413e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 --2- 172.21.15.57:0/3704683641 >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 -- 172.21.15.57:0/3704683641 >> v1:172.21.15.105:6789/0 conn(0x7fd8b41384b0 legacy=0x7fd8b40b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 -- 172.21.15.57:0/3704683641 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b41419e0 con 0x7fd8b406a1e0 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba92d700 1 --2- 172.21.15.57:0/3704683641 >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8ba12c700 1 --2- 172.21.15.57:0/3704683641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009eb0 tx=0x7fd8ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742cf3b715b6d74f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8b912a700 1 -- 172.21.15.57:0/3704683641 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00e070 con 0x7fd8b406a1e0 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8b912a700 1 -- 172.21.15.57:0/3704683641 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00bc30 con 0x7fd8b406a1e0 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8b912a700 1 -- 172.21.15.57:0/3704683641 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac012430 con 0x7fd8b406a1e0 2023-10-06T03:55:02.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 -- 172.21.15.57:0/3704683641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 msgr2=0x7fd8b40aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/3704683641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009eb0 tx=0x7fd8ac009780 comp rx=0 tx=0).stop 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 -- 172.21.15.57:0/3704683641 shutdown_connections 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/3704683641 >> v2:172.21.15.105:3300/0 conn(0x7fd8b41421a0 0x7fd8b413e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/3704683641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b406a1e0 0x7fd8b40aafa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 -- 172.21.15.57:0/3704683641 >> 172.21.15.57:0/3704683641 conn(0x7fd8b40688d0 msgr2=0x7fd8b4068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 -- 172.21.15.57:0/3704683641 shutdown_connections 2023-10-06T03:55:02.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.083+0000 7fd8bb12e700 1 -- 172.21.15.57:0/3704683641 wait complete. 2023-10-06T03:55:02.091 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 Processor -- start 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- start start 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 0x7fd8b406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b41384b0 0x7fd8b4153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8b41421a0 0x7fd8b4138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b413a040 con 0x7fd8b406a1e0 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40abc10 con 0x7fd8b41421a0 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40abef0 con 0x7fd8b41384b0 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 0x7fd8b406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 0x7fd8b406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41692/0 (socket says 172.21.15.57:41692) 2023-10-06T03:55:02.092 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 -- 172.21.15.57:0/2407780018 learned_addr learned my addr 172.21.15.57:0/2407780018 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8b992b700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b41384b0 0x7fd8b4153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba92d700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8b41421a0 0x7fd8b4138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 -- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b41384b0 msgr2=0x7fd8b4153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8b41384b0 0x7fd8b4153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 -- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8b41421a0 msgr2=0x7fd8b4138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8b41421a0 0x7fd8b4138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40094f0 con 0x7fd8b406a1e0 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba92d700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8b41421a0 0x7fd8b4138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8ba12c700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 0x7fd8b406e4e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac012580 tx=0x7fd8ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac012d00 con 0x7fd8b406a1e0 2023-10-06T03:55:02.093 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac012e60 con 0x7fd8b406a1e0 2023-10-06T03:55:02.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac009a20 con 0x7fd8b406a1e0 2023-10-06T03:55:02.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0276c0 con 0x7fd8b406a1e0 2023-10-06T03:55:02.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b4153b70 con 0x7fd8b406a1e0 2023-10-06T03:55:02.094 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.087+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8b40aba70 con 0x7fd8b406a1e0 2023-10-06T03:55:02.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fd8ac024070 con 0x7fd8b406a1e0 2023-10-06T03:55:02.095 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd8a0060550 0x7fd8a0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7fd8ac07f100 con 0x7fd8b406a1e0 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b992b700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd8a0060550 0x7fd8a0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7fd8a0068f80 0x7fd8a006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8a006bac0 con 0x7fd8a0068f80 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ac07f4d0 con 0x7fd8b406a1e0 2023-10-06T03:55:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8ba92d700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7fd8a0068f80 0x7fd8a006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.091+0000 7fd8b992b700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd8a0060550 0x7fd8a0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8b413a600 tx=0x7fd8a8000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.095+0000 7fd8ba92d700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7fd8a0068f80 0x7fd8a006b3f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.095+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== osd.2 v2:172.21.15.57:6808/33347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd8a006bac0 con 0x7fd8a0068f80 2023-10-06T03:55:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 --> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd8b406b7b0 con 0x7fd8a0068f80 2023-10-06T03:55:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8b27fc700 1 -- 172.21.15.57:0/2407780018 <== osd.2 v2:172.21.15.57:6808/33347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd8b406b7b0 con 0x7fd8a0068f80 2023-10-06T03:55:02.119 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:02.119 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:02.119 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7fd8a0068f80 msgr2=0x7fd8a006b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:6808/33347,v1:172.21.15.57:6809/33347] conn(0x7fd8a0068f80 0x7fd8a006b3f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd8a0060550 msgr2=0x7fd8a0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fd8a0060550 0x7fd8a0062a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8b413a600 tx=0x7fd8a8000bc0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 msgr2=0x7fd8b406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 --2- 172.21.15.57:0/2407780018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8b406a1e0 0x7fd8b406e4e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac012580 tx=0x7fd8ac019000 comp rx=0 tx=0).stop 2023-10-06T03:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8ba92d700 1 -- 172.21.15.57:0/2407780018 reap_dead start 2023-10-06T03:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 shutdown_connections 2023-10-06T03:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 >> 172.21.15.57:0/2407780018 conn(0x7fd8b40688d0 msgr2=0x7fd8b406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 shutdown_connections 2023-10-06T03:55:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.115+0000 7fd8bb12e700 1 -- 172.21.15.57:0/2407780018 wait complete. 2023-10-06T03:55:02.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:55:02.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.239+0000 7f00d6949700 1 Processor -- start 2023-10-06T03:55:02.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.239+0000 7f00d6949700 1 -- start start 2023-10-06T03:55:02.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 0x7f00d00a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00d0095e20 0x7f00d00a7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d0094d60 con 0x7f00d00b49a0 2023-10-06T03:55:02.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d00b0660 con 0x7f00d0095e20 2023-10-06T03:55:02.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00b0940 con 0x7f00d00af050 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00d0095e20 0x7f00d00a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d5947700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f00d00b49a0 0x7f00d0095710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45238/0 (socket says 172.21.15.57:45238) 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d5947700 1 -- 172.21.15.57:0/1082420410 learned_addr learned my addr 172.21.15.57:0/1082420410 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d5146700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 0x7f00d00a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d4945700 1 -- 172.21.15.57:0/1082420410 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035316123 0 0) 0x7f00d0094d60 con 0x7f00d00b49a0 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d4945700 1 -- 172.21.15.57:0/1082420410 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00bc003570 con 0x7f00d00b49a0 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 -- 172.21.15.57:0/1082420410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 msgr2=0x7f00d00a6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 0x7f00d00a6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 -- 172.21.15.57:0/1082420410 >> v1:172.21.15.57:6789/0 conn(0x7f00d00b49a0 legacy=0x7f00d0095710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 -- 172.21.15.57:0/1082420410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00b4d70 con 0x7f00d0095e20 2023-10-06T03:55:02.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d5146700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 0x7f00d00a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6148700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d0095e20 0x7f00d00a7280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00c80098e0 tx=0x7f00c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df183743e14b3afc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d4945700 1 -- 172.21.15.57:0/1082420410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011630 con 0x7f00d0095e20 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d4945700 1 -- 172.21.15.57:0/1082420410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8011790 con 0x7f00d0095e20 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d4945700 1 -- 172.21.15.57:0/1082420410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011b30 con 0x7f00d0095e20 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- 172.21.15.57:0/1082420410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d0095e20 msgr2=0x7f00d00a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d0095e20 0x7f00d00a7280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f00c80098e0 tx=0x7f00c80091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- 172.21.15.57:0/1082420410 shutdown_connections 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00af050 0x7f00d00a6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 --2- 172.21.15.57:0/1082420410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d0095e20 0x7f00d00a7280 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- 172.21.15.57:0/1082420410 >> 172.21.15.57:0/1082420410 conn(0x7f00d009a040 msgr2=0x7f00d0068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.364 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- 172.21.15.57:0/1082420410 shutdown_connections 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.243+0000 7f00d6949700 1 -- 172.21.15.57:0/1082420410 wait complete. 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 Processor -- start 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- start start 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 0x7f00d00a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00b49a0 0x7f00d0097750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00ae870 con 0x7f00d00af050 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0098e30 con 0x7f00d0095e20 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0098830 con 0x7f00d00b49a0 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41710/0 (socket says 172.21.15.57:41710) 2023-10-06T03:55:02.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 -- 172.21.15.57:0/294891003 learned_addr learned my addr 172.21.15.57:0/294891003 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6148700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00b49a0 0x7f00d0097750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5947700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 0x7f00d00a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 -- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00b49a0 msgr2=0x7f00d0097750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00b49a0 0x7f00d0097750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 -- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 msgr2=0x7f00d00a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 0x7f00d00a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 -- 172.21.15.57:0/294891003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009a20 con 0x7f00d00af050 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5947700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 0x7f00d00a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d5146700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c170 tx=0x7f00cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00cd60 con 0x7f00d00af050 2023-10-06T03:55:02.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00f040 con 0x7f00d00af050 2023-10-06T03:55:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c8009420 con 0x7f00d00af050 2023-10-06T03:55:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0146b0 con 0x7f00d00af050 2023-10-06T03:55:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.247+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00995c0 con 0x7f00d00af050 2023-10-06T03:55:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.251+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d0068f50 con 0x7f00d00af050 2023-10-06T03:55:02.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.251+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f00cc014a20 con 0x7f00d00af050 2023-10-06T03:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.251+0000 7f00c5ffb700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 0x7f00b4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.251+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f00cc07d8d0 con 0x7f00d00af050 2023-10-06T03:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.251+0000 7f00d5947700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 0x7f00b4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.255+0000 7f00d5947700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 0x7f00b4062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00c0001200 tx=0x7f00c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.388 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.263+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f00cc04dc50 con 0x7f00d00af050 2023-10-06T03:55:02.430 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.427+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d0098f70 con 0x7f00b4060550 2023-10-06T03:55:02.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.427+0000 7f00c5ffb700 1 -- 172.21.15.57:0/294891003 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f00d0098f70 con 0x7f00b4060550 2023-10-06T03:55:02.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 msgr2=0x7f00b4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 0x7f00b4062a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00c0001200 tx=0x7f00c0009040 comp rx=0 tx=0).stop 2023-10-06T03:55:02.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 msgr2=0x7f00d00a7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c170 tx=0x7f00cc00b040 comp rx=0 tx=0).stop 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 shutdown_connections 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f00b4060550 0x7f00b4062a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d00b49a0 0x7f00d0097750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00d00af050 0x7f00d00a7380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 --2- 172.21.15.57:0/294891003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d0095e20 0x7f00d00a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 >> 172.21.15.57:0/294891003 conn(0x7f00d009a040 msgr2=0x7f00d0096a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 shutdown_connections 2023-10-06T03:55:02.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.431+0000 7f00d6949700 1 -- 172.21.15.57:0/294891003 wait complete. 2023-10-06T03:55:02.436 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:55:02.445 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:55:02.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 Processor -- start 2023-10-06T03:55:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 -- start start 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18700b5bd0 0x7f1870068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870146700 con 0x7f187006df90 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18700b22a0 con 0x7f1870142f60 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1877db9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870142480 con 0x7f18700b5bd0 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1875b55700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18700b5bd0 0x7f1870068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1876356700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f187006df90 0x7f1870145ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45244/0 (socket says 172.21.15.57:45244) 2023-10-06T03:55:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1876356700 1 -- 172.21.15.57:0/3786899833 learned_addr learned my addr 172.21.15.57:0/3786899833 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:02.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1875b55700 1 -- 172.21.15.57:0/3786899833 >> v1:172.21.15.105:6789/0 conn(0x7f1870142f60 legacy=0x7f18701458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1875b55700 1 -- 172.21.15.57:0/3786899833 >> v1:172.21.15.57:6789/0 conn(0x7f187006df90 legacy=0x7f1870145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1874b53700 1 -- 172.21.15.57:0/3786899833 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682979845 0 0) 0x7f18700b22a0 con 0x7f1870142f60 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1875b55700 1 -- 172.21.15.57:0/3786899833 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870142760 con 0x7f18700b5bd0 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1875b55700 1 --2- 172.21.15.57:0/3786899833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18700b5bd0 0x7f1870068650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f186c0098e0 tx=0x7f186c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01f6985bc17370f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1874b53700 1 -- 172.21.15.57:0/3786899833 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c009e80 con 0x7f18700b5bd0 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1874b53700 1 -- 172.21.15.57:0/3786899833 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c00b760 con 0x7f18700b5bd0 2023-10-06T03:55:02.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.555+0000 7f1874b53700 1 -- 172.21.15.57:0/3786899833 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00bae0 con 0x7f18700b5bd0 2023-10-06T03:55:02.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- 172.21.15.57:0/3786899833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18700b5bd0 msgr2=0x7f1870068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 --2- 172.21.15.57:0/3786899833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18700b5bd0 0x7f1870068650 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f186c0098e0 tx=0x7f186c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- 172.21.15.57:0/3786899833 shutdown_connections 2023-10-06T03:55:02.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 --2- 172.21.15.57:0/3786899833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18700b5bd0 0x7f1870068650 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- 172.21.15.57:0/3786899833 >> 172.21.15.57:0/3786899833 conn(0x7f187006af50 msgr2=0x7f187006b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- 172.21.15.57:0/3786899833 shutdown_connections 2023-10-06T03:55:02.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- 172.21.15.57:0/3786899833 wait complete. 2023-10-06T03:55:02.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 Processor -- start 2023-10-06T03:55:02.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.559+0000 7f1877db9700 1 -- start start 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f187006df90 0x7f18700aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18700b5bd0 0x7f1870139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 0x7f1870155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18701452c0 con 0x7f1870142f60 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187013d360 con 0x7f187006df90 2023-10-06T03:55:02.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1870152b40 con 0x7f18700b5bd0 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 0x7f1870155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 0x7f1870155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41726/0 (socket says 172.21.15.57:41726) 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 -- 172.21.15.57:0/2409212686 learned_addr learned my addr 172.21.15.57:0/2409212686 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1875354700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18700b5bd0 0x7f1870139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1875b55700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f187006df90 0x7f18700aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 -- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18700b5bd0 msgr2=0x7f1870139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18700b5bd0 0x7f1870139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 -- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f187006df90 msgr2=0x7f18700aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f187006df90 0x7f18700aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009420 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1876356700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 0x7f1870155570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1868002230 tx=0x7f1868001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800ab30 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800ac90 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187013d590 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868007340 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18701525a0 con 0x7f1870142f60 2023-10-06T03:55:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.563+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18700ace30 con 0x7f1870142f60 2023-10-06T03:55:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f1868007730 con 0x7f1870142f60 2023-10-06T03:55:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1854060580 0x7f1854062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f186807d8b0 con 0x7f1870142f60 2023-10-06T03:55:02.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1875b55700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1854060580 0x7f1854062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7f1854068fb0 0x7f185406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f185406baf0 con 0x7f1854068fb0 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f186807dc80 con 0x7f1870142f60 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1875354700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7f1854068fb0 0x7f185406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1875b55700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1854060580 0x7f1854062a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f186c0030c0 tx=0x7f186c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1875354700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7f1854068fb0 0x7f185406b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.567+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== osd.3 v2:172.21.15.57:6800/33348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f185406baf0 con 0x7f1854068fb0 2023-10-06T03:55:02.589 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 --> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f187004be00 con 0x7f1854068fb0 2023-10-06T03:55:02.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1865ffb700 1 -- 172.21.15.57:0/2409212686 <== osd.3 v2:172.21.15.57:6800/33348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f187004be00 con 0x7f1854068fb0 2023-10-06T03:55:02.590 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:02.591 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7f1854068fb0 msgr2=0x7f185406b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:6800/33348,v1:172.21.15.57:6801/33348] conn(0x7f1854068fb0 0x7f185406b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1854060580 msgr2=0x7f1854062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f1854060580 0x7f1854062a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f186c0030c0 tx=0x7f186c016000 comp rx=0 tx=0).stop 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 msgr2=0x7f1870155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 --2- 172.21.15.57:0/2409212686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1870142f60 0x7f1870155570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1868002230 tx=0x7f1868001b90 comp rx=0 tx=0).stop 2023-10-06T03:55:02.592 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1876356700 1 -- 172.21.15.57:0/2409212686 reap_dead start 2023-10-06T03:55:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 shutdown_connections 2023-10-06T03:55:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 >> 172.21.15.57:0/2409212686 conn(0x7f187006af50 msgr2=0x7f18700b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 shutdown_connections 2023-10-06T03:55:02.593 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.587+0000 7f1877db9700 1 -- 172.21.15.57:0/2409212686 wait complete. 2023-10-06T03:55:02.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:55:02.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 Processor -- start 2023-10-06T03:55:02.718 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 -- start start 2023-10-06T03:55:02.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a500b5560 0x7f7a500b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500b5930 0x7f7a5014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500b1e70 con 0x7f7a500aff40 2023-10-06T03:55:02.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a500b2e50 con 0x7f7a500b5560 2023-10-06T03:55:02.719 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a57558700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500b48e0 con 0x7f7a500b5930 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a500b5560 0x7f7a500b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a55d55700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7a500aff40 0x7f7a50145d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45250/0 (socket says 172.21.15.57:45250) 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a55d55700 1 -- 172.21.15.57:0/2250496461 learned_addr learned my addr 172.21.15.57:0/2250496461 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56d57700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500b5930 0x7f7a5014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a55554700 1 -- 172.21.15.57:0/2250496461 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743379008 0 0) 0x7f7a500b1e70 con 0x7f7a500aff40 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a55554700 1 -- 172.21.15.57:0/2250496461 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a3c003570 con 0x7f7a500aff40 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 -- 172.21.15.57:0/2250496461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500b5930 msgr2=0x7f7a5014ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:02.721 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500b5930 0x7f7a5014ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 -- 172.21.15.57:0/2250496461 >> v1:172.21.15.57:6789/0 conn(0x7f7a500aff40 legacy=0x7f7a50145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 -- 172.21.15.57:0/2250496461 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a500b4bc0 con 0x7f7a500b5560 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.715+0000 7f7a56556700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a500b2910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a400098e0 tx=0x7f7a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3be2c18e5a581c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a55554700 1 -- 172.21.15.57:0/2250496461 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40011630 con 0x7f7a500b5560 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a55554700 1 -- 172.21.15.57:0/2250496461 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40011790 con 0x7f7a500b5560 2023-10-06T03:55:02.722 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a55554700 1 -- 172.21.15.57:0/2250496461 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40011b10 con 0x7f7a500b5560 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- 172.21.15.57:0/2250496461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 msgr2=0x7f7a500b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a500b2910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a400098e0 tx=0x7f7a400091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- 172.21.15.57:0/2250496461 shutdown_connections 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500b5930 0x7f7a5014ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- 172.21.15.57:0/2250496461 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a500b2910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- 172.21.15.57:0/2250496461 >> 172.21.15.57:0/2250496461 conn(0x7f7a50068f20 msgr2=0x7f7a50069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- 172.21.15.57:0/2250496461 shutdown_connections 2023-10-06T03:55:02.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- 172.21.15.57:0/2250496461 wait complete. 2023-10-06T03:55:02.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 Processor -- start 2023-10-06T03:55:02.725 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- start start 2023-10-06T03:55:02.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500aff40 0x7f7a50143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b5930 0x7f7a50155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50144ed0 con 0x7f7a500b5560 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50141210 con 0x7f7a500b5930 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.719+0000 7f7a57558700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500a4c20 con 0x7f7a500aff40 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41744/0 (socket says 172.21.15.57:41744) 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 -- 172.21.15.57:0/732990008 learned_addr learned my addr 172.21.15.57:0/732990008 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a56556700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500aff40 0x7f7a50143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a56d57700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b5930 0x7f7a50155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 -- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500aff40 msgr2=0x7f7a50143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500aff40 0x7f7a50143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 -- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b5930 msgr2=0x7f7a50155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b5930 0x7f7a50155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 -- 172.21.15.57:0/732990008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009420 con 0x7f7a500b5560 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a55d55700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0011e0 tx=0x7f7a4c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c005b30 con 0x7f7a500b5560 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c005cb0 con 0x7f7a500b5560 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a50145420 con 0x7f7a500b5560 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c007320 con 0x7f7a500b5560 2023-10-06T03:55:02.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a500a4f00 con 0x7f7a500b5560 2023-10-06T03:55:02.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a50145280 con 0x7f7a500b5560 2023-10-06T03:55:02.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.723+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f7a4c01b3b0 con 0x7f7a500b5560 2023-10-06T03:55:02.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.727+0000 7f7a467fc700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 0x7f7a34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:02.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.727+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f7a4c07bce0 con 0x7f7a500b5560 2023-10-06T03:55:02.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.727+0000 7f7a56556700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 0x7f7a34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:02.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.727+0000 7f7a56556700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 0x7f7a34062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a400091e0 tx=0x7f7a40017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:02.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.731+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7a50145280 con 0x7f7a500b5560 2023-10-06T03:55:02.890 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.887+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a50145280 con 0x7f7a34060550 2023-10-06T03:55:02.891 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.887+0000 7f7a467fc700 1 -- 172.21.15.57:0/732990008 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7a50145280 con 0x7f7a34060550 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 msgr2=0x7f7a34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 0x7f7a34062a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a400091e0 tx=0x7f7a40017000 comp rx=0 tx=0).stop 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 msgr2=0x7f7a501524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0011e0 tx=0x7f7a4c007df0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 shutdown_connections 2023-10-06T03:55:02.894 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f7a34060550 0x7f7a34062a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b5930 0x7f7a50155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a500b5560 0x7f7a501524a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 --2- 172.21.15.57:0/732990008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a500aff40 0x7f7a50143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 >> 172.21.15.57:0/732990008 conn(0x7f7a50068f20 msgr2=0x7f7a5013ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 shutdown_connections 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:02.891+0000 7f7a57558700 1 -- 172.21.15.57:0/732990008 wait complete. 2023-10-06T03:55:02.895 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:55:02.906 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:55:02.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 Processor -- start 2023-10-06T03:55:03.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 -- start start 2023-10-06T03:55:03.028 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 0x7f8cc4142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc40b1ef0 con 0x7f8cc40672a0 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc40b51f0 con 0x7f8cc40b2b90 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.023+0000 7f8cc8fd2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40b4c30 con 0x7f8cc4142950 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.029 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cbbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 0x7f8cc4142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cbbfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 0x7f8cc4142410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.57:44134/0 (socket says 172.21.15.57:44134) 2023-10-06T03:55:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:55008/0 (socket says 172.21.15.57:55008) 2023-10-06T03:55:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc37fe700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8cc40672a0 0x7f8cc40b08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41582/0 (socket says 172.21.15.57:41582) 2023-10-06T03:55:03.030 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cbbfff700 1 -- 172.21.15.57:0/2811384247 learned_addr learned my addr 172.21.15.57:0/2811384247 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 -- 172.21.15.57:0/2811384247 >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 msgr2=0x7f8cc4142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 --2- 172.21.15.57:0/2811384247 >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 0x7f8cc4142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 -- 172.21.15.57:0/2811384247 >> v1:172.21.15.105:6789/0 conn(0x7f8cc40672a0 legacy=0x7f8cc40b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 -- 172.21.15.57:0/2811384247 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc40b4f10 con 0x7f8cc4142950 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc3fff700 1 --2- 172.21.15.57:0/2811384247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009e60 tx=0x7f8cbc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b70f0c0b9dac5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc2ffd700 1 -- 172.21.15.57:0/2811384247 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00e070 con 0x7f8cc4142950 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc2ffd700 1 -- 172.21.15.57:0/2811384247 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc00bb60 con 0x7f8cc4142950 2023-10-06T03:55:03.031 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc2ffd700 1 -- 172.21.15.57:0/2811384247 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc012430 con 0x7f8cc4142950 2023-10-06T03:55:03.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/2811384247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 msgr2=0x7f8cc414cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/2811384247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc009e60 tx=0x7f8cbc009780 comp rx=0 tx=0).stop 2023-10-06T03:55:03.032 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/2811384247 shutdown_connections 2023-10-06T03:55:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/2811384247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc4142950 0x7f8cc414cad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/2811384247 >> v2:172.21.15.105:3300/0 conn(0x7f8cc40b2b90 0x7f8cc4142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/2811384247 >> 172.21.15.57:0/2811384247 conn(0x7f8cc40b8b70 msgr2=0x7f8cc40b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/2811384247 shutdown_connections 2023-10-06T03:55:03.033 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.027+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/2811384247 wait complete. 2023-10-06T03:55:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 Processor -- start 2023-10-06T03:55:03.034 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 -- start start 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc40672a0 0x7f8cc4155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cc40b2b90 0x7f8cc40aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cc4142950 0x7f8cc40ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc40a4e30 con 0x7f8cc40b2b90 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4155920 con 0x7f8cc4142950 2023-10-06T03:55:03.035 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc8fd2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc41562f0 con 0x7f8cc40672a0 2023-10-06T03:55:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cc40b2b90 0x7f8cc40aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc37fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc40672a0 0x7f8cc4155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.036 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc3fff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cc4142950 0x7f8cc40ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc37fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc40672a0 0x7f8cc4155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:55014/0 (socket says 172.21.15.57:55014) 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cc37fe700 1 -- 172.21.15.57:0/1553990679 learned_addr learned my addr 172.21.15.57:0/1553990679 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 -- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc40672a0 msgr2=0x7f8cc4155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cc40672a0 0x7f8cc4155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 -- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cc4142950 msgr2=0x7f8cc40ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cc4142950 0x7f8cc40ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cbc009a20 con 0x7f8cc40b2b90 2023-10-06T03:55:03.037 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.031+0000 7f8cbbfff700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cc40b2b90 0x7f8cc40aebc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006d40 tx=0x7f8cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac013680 con 0x7f8cc40b2b90 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac0137e0 con 0x7f8cc40b2b90 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4145820 con 0x7f8cc40b2b90 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac013b80 con 0x7f8cc40b2b90 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc40af960 con 0x7f8cc40b2b90 2023-10-06T03:55:03.038 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cc406a090 con 0x7f8cc40b2b90 2023-10-06T03:55:03.039 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f8cac00c3e0 con 0x7f8cc40b2b90 2023-10-06T03:55:03.040 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.035+0000 7f8cbb7fe700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8ca4060550 0x7f8ca4062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f8cac07ca00 con 0x7f8cc40b2b90 2023-10-06T03:55:03.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cc37fe700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8ca4060550 0x7f8ca4062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cbb7fe700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f8ca4068f80 0x7f8ca406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ca406bac0 con 0x7f8ca4068f80 2023-10-06T03:55:03.041 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cac081240 con 0x7f8cc40b2b90 2023-10-06T03:55:03.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cc3fff700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f8ca4068f80 0x7f8ca406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cc37fe700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8ca4060550 0x7f8ca4062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4004fd0 tx=0x7f8cb4007f70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.042 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cc3fff700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f8ca4068f80 0x7f8ca406b3f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.045 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.039+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== osd.4 v2:172.21.15.105:6804/33626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8ca406bac0 con 0x7f8ca4068f80 2023-10-06T03:55:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 --> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8cc4142130 con 0x7f8ca4068f80 2023-10-06T03:55:03.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cbb7fe700 1 -- 172.21.15.57:0/1553990679 <== osd.4 v2:172.21.15.105:6804/33626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8cc4142130 con 0x7f8ca4068f80 2023-10-06T03:55:03.064 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:03.064 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:03.064 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f8ca4068f80 msgr2=0x7f8ca406b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6804/33626,v1:172.21.15.105:6806/33626] conn(0x7f8ca4068f80 0x7f8ca406b3f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8ca4060550 msgr2=0x7f8ca4062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8ca4060550 0x7f8ca4062a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4004fd0 tx=0x7f8cb4007f70 comp rx=0 tx=0).stop 2023-10-06T03:55:03.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cc40b2b90 msgr2=0x7f8cc40aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 --2- 172.21.15.57:0/1553990679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cc40b2b90 0x7f8cc40aebc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8cac006d40 tx=0x7f8cac009250 comp rx=0 tx=0).stop 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc3fff700 1 -- 172.21.15.57:0/1553990679 reap_dead start 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 shutdown_connections 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 >> 172.21.15.57:0/1553990679 conn(0x7f8cc40b8b70 msgr2=0x7f8cc40b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 shutdown_connections 2023-10-06T03:55:03.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.059+0000 7f8cc8fd2700 1 -- 172.21.15.57:0/1553990679 wait complete. 2023-10-06T03:55:03.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:55:03.073 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:55:03.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:55:03.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 Processor -- start 2023-10-06T03:55:03.279 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 -- start start 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48100701c0 0x7f481013f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48100b1760 0x7f481013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4810097ed0 con 0x7f4810097320 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481013f110 con 0x7f48100701c0 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.275+0000 7f4814ed2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4810069f30 con 0x7f48100b1760 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48100701c0 0x7f481013f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4805d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48100b1760 0x7f481013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480ed9d700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4810097320 0x7f48100977c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.57:41592/0 (socket says 172.21.15.57:41592) 2023-10-06T03:55:03.281 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480ed9d700 1 -- 172.21.15.57:0/777433499 learned_addr learned my addr 172.21.15.57:0/777433499 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:03.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 -- 172.21.15.57:0/777433499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48100b1760 msgr2=0x7f481013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480dd9b700 1 -- 172.21.15.57:0/777433499 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160131025 0 0) 0x7f4810097ed0 con 0x7f4810097320 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 --2- 172.21.15.57:0/777433499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48100b1760 0x7f481013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 -- 172.21.15.57:0/777433499 >> v1:172.21.15.105:6789/0 conn(0x7f4810097320 legacy=0x7f48100977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 -- 172.21.15.57:0/777433499 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481006a210 con 0x7f48100701c0 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480e59c700 1 --2- 172.21.15.57:0/777433499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f481013f610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f48000098e0 tx=0x7f48000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc0239217c21438 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480dd9b700 1 -- 172.21.15.57:0/777433499 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000b640 con 0x7f48100701c0 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480dd9b700 1 -- 172.21.15.57:0/777433499 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480000b7a0 con 0x7f48100701c0 2023-10-06T03:55:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f480dd9b700 1 -- 172.21.15.57:0/777433499 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000bb40 con 0x7f48100701c0 2023-10-06T03:55:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- 172.21.15.57:0/777433499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 msgr2=0x7f481013f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 --2- 172.21.15.57:0/777433499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f481013f610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f48000098e0 tx=0x7f48000091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- 172.21.15.57:0/777433499 shutdown_connections 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 --2- 172.21.15.57:0/777433499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48100b1760 0x7f481013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 --2- 172.21.15.57:0/777433499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f481013f610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- 172.21.15.57:0/777433499 >> 172.21.15.57:0/777433499 conn(0x7f48100b26e0 msgr2=0x7f4810069290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- 172.21.15.57:0/777433499 shutdown_connections 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- 172.21.15.57:0/777433499 wait complete. 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 Processor -- start 2023-10-06T03:55:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.279+0000 7f4814ed2700 1 -- start start 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4810097320 0x7f4810150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 0x7f481013cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481006c6c0 con 0x7f48100701c0 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4810150270 con 0x7f48100b1760 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481006e940 con 0x7f4810097320 2023-10-06T03:55:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41768/0 (socket says 172.21.15.57:41768) 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 -- 172.21.15.57:0/350098267 learned_addr learned my addr 172.21.15.57:0/350098267 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4805d9b700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4810097320 0x7f4810150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480ed9d700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 0x7f481013cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 -- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4810097320 msgr2=0x7f4810150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4810097320 0x7f4810150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 -- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 msgr2=0x7f481013cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 0x7f481013cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 -- 172.21.15.57:0/350098267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800009420 con 0x7f48100701c0 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480ed9d700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 0x7f481013cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f480e59c700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f48000093f0 tx=0x7f4800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800000bc0 con 0x7f48100701c0 2023-10-06T03:55:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480000b910 con 0x7f48100701c0 2023-10-06T03:55:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810141800 con 0x7f48100701c0 2023-10-06T03:55:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4800025670 con 0x7f48100701c0 2023-10-06T03:55:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481006e660 con 0x7f48100701c0 2023-10-06T03:55:03.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.283+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4810150040 con 0x7f48100701c0 2023-10-06T03:55:03.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.287+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4800023070 con 0x7f48100701c0 2023-10-06T03:55:03.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.287+0000 7f4806ffd700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 0x7f47f0062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.287+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f480007db30 con 0x7f48100701c0 2023-10-06T03:55:03.290 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.287+0000 7f4805d9b700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 0x7f47f0062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.287+0000 7f4805d9b700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 0x7f47f0062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f481013efc0 tx=0x7f47f8012040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.298 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.295+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4810150040 con 0x7f48100701c0 2023-10-06T03:55:03.468 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.463+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f48101503b0 con 0x7f47f0060580 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.467+0000 7f4806ffd700 1 -- 172.21.15.57:0/350098267 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47f8016040 con 0x7f47f0060580 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 msgr2=0x7f47f0062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 0x7f47f0062a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f481013efc0 tx=0x7f47f8012040 comp rx=0 tx=0).stop 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 msgr2=0x7f4810140430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f48000093f0 tx=0x7f4800017000 comp rx=0 tx=0).stop 2023-10-06T03:55:03.476 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 shutdown_connections 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f47f0060580 0x7f47f0062a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48100b1760 0x7f481013cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4810097320 0x7f4810150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 --2- 172.21.15.57:0/350098267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48100701c0 0x7f4810140430 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 >> 172.21.15.57:0/350098267 conn(0x7f48100b26e0 msgr2=0x7f4810069290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 shutdown_connections 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.471+0000 7f4814ed2700 1 -- 172.21.15.57:0/350098267 wait complete. 2023-10-06T03:55:03.477 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:55:03.489 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:55:03.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:03.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.595+0000 7f381d717700 1 Processor -- start 2023-10-06T03:55:03.599 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.595+0000 7f381d717700 1 -- start start 2023-10-06T03:55:03.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38180672a0 0x7f38180b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f3818142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.602 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180b1ef0 con 0x7f38180b0de0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3818143060 con 0x7f38180672a0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180b51f0 con 0x7f38180b2b90 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38180672a0 0x7f38180b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381cf16700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f38180b0de0 0x7f3818142950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45266/0 (socket says 172.21.15.57:45266) 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381cf16700 1 -- 172.21.15.57:0/1265564424 learned_addr learned my addr 172.21.15.57:0/1265564424 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38180672a0 0x7f38180b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41772/0 (socket says 172.21.15.57:41772) 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f38177fe700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f3818142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3816ffd700 1 -- 172.21.15.57:0/1265564424 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427870855 0 0) 0x7f38180b1ef0 con 0x7f38180b0de0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3816ffd700 1 -- 172.21.15.57:0/1265564424 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003570 con 0x7f38180b0de0 2023-10-06T03:55:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 -- 172.21.15.57:0/1265564424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 msgr2=0x7f3818142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f3818142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 -- 172.21.15.57:0/1265564424 >> v1:172.21.15.57:6789/0 conn(0x7f38180b0de0 legacy=0x7f3818142950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 -- 172.21.15.57:0/1265564424 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180b4c30 con 0x7f38180672a0 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f38177fe700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f3818142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3817fff700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180672a0 0x7f38180b08a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f38080098e0 tx=0x7f38080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559cc7faf9a89df8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3816ffd700 1 -- 172.21.15.57:0/1265564424 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800b640 con 0x7f38180672a0 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3816ffd700 1 -- 172.21.15.57:0/1265564424 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380800b7a0 con 0x7f38180672a0 2023-10-06T03:55:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f3816ffd700 1 -- 172.21.15.57:0/1265564424 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800bb40 con 0x7f38180672a0 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- 172.21.15.57:0/1265564424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180672a0 msgr2=0x7f38180b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180672a0 0x7f38180b08a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f38080098e0 tx=0x7f38080091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- 172.21.15.57:0/1265564424 shutdown_connections 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f3818142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 --2- 172.21.15.57:0/1265564424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180672a0 0x7f38180b08a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- 172.21.15.57:0/1265564424 >> 172.21.15.57:0/1265564424 conn(0x7f38180b8b70 msgr2=0x7f38180b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- 172.21.15.57:0/1265564424 shutdown_connections 2023-10-06T03:55:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.599+0000 7f381d717700 1 -- 172.21.15.57:0/1265564424 wait complete. 2023-10-06T03:55:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 Processor -- start 2023-10-06T03:55:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 -- start start 2023-10-06T03:55:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38180672a0 0x7f3818145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 0x7f38180adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f38180ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180af930 con 0x7f38180b0de0 2023-10-06T03:55:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180af050 con 0x7f38180672a0 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381d717700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180a5860 con 0x7f38180b2b90 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f38177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 0x7f38180adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f38177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 0x7f38180adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41778/0 (socket says 172.21.15.57:41778) 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f38177fe700 1 -- 172.21.15.57:0/2240755525 learned_addr learned my addr 172.21.15.57:0/2240755525 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f3817fff700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38180672a0 0x7f3818145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.603+0000 7f381cf16700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f38180ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.610 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 -- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 msgr2=0x7f38180ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f38180ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 -- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38180672a0 msgr2=0x7f3818145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38180672a0 0x7f3818145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3808009420 con 0x7f38180b0de0 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f381cf16700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38180b2b90 0x7f38180ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f38177fe700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 0x7f38180adc90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f380000d7e0 tx=0x7f3800008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000125f0 con 0x7f38180b0de0 2023-10-06T03:55:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800012750 con 0x7f38180b0de0 2023-10-06T03:55:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180a55f0 con 0x7f38180b0de0 2023-10-06T03:55:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800012af0 con 0x7f38180b0de0 2023-10-06T03:55:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180aece0 con 0x7f38180b0de0 2023-10-06T03:55:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38180ae820 con 0x7f38180b0de0 2023-10-06T03:55:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.607+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f380001e460 con 0x7f38180b0de0 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f37f8060550 0x7f37f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f380007cff0 con 0x7f38180b0de0 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7f37f8068f80 0x7f37f806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f3817fff700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f37f8060550 0x7f37f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37f806bac0 con 0x7f37f8068f80 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f380007f630 con 0x7f38180b0de0 2023-10-06T03:55:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f381cf16700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7f37f8068f80 0x7f37f806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f3817fff700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f37f8060550 0x7f37f8062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f38080093f0 tx=0x7f3808017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f381cf16700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7f37f8068f80 0x7f37f806b3f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.616 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.611+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== osd.5 v2:172.21.15.105:6824/33628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f37f806bac0 con 0x7f37f8068f80 2023-10-06T03:55:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 --> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f381806a090 con 0x7f37f8068f80 2023-10-06T03:55:03.634 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f380ffff700 1 -- 172.21.15.57:0/2240755525 <== osd.5 v2:172.21.15.105:6824/33628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f381806a090 con 0x7f37f8068f80 2023-10-06T03:55:03.634 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:03.634 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:03.634 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:03.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7f37f8068f80 msgr2=0x7f37f806b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6824/33628,v1:172.21.15.105:6825/33628] conn(0x7f37f8068f80 0x7f37f806b3f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f37f8060550 msgr2=0x7f37f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f37f8060550 0x7f37f8062a00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f38080093f0 tx=0x7f3808017000 comp rx=0 tx=0).stop 2023-10-06T03:55:03.635 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 msgr2=0x7f38180adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 --2- 172.21.15.57:0/2240755525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38180b0de0 0x7f38180adc90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f380000d7e0 tx=0x7f3800008040 comp rx=0 tx=0).stop 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381cf16700 1 -- 172.21.15.57:0/2240755525 reap_dead start 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 shutdown_connections 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 >> 172.21.15.57:0/2240755525 conn(0x7f38180b8b70 msgr2=0x7f38180b8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 shutdown_connections 2023-10-06T03:55:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.631+0000 7f381d717700 1 -- 172.21.15.57:0/2240755525 wait complete. 2023-10-06T03:55:03.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:55:03.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 Processor -- start 2023-10-06T03:55:03.754 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 -- start start 2023-10-06T03:55:03.757 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe59c0701c0 0x7fe59c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe59c0b1760 0x7fe59c13fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c13f110 con 0x7fe59c097320 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c069f30 con 0x7fe59c0701c0 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a41e7700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c06a210 con 0x7fe59c0b1760 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a1f83700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe59c0701c0 0x7fe59c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a2784700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe59c097320 0x7fe59c097760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45280/0 (socket says 172.21.15.57:45280) 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a2784700 1 -- 172.21.15.57:0/3031784655 learned_addr learned my addr 172.21.15.57:0/3031784655 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:03.758 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.751+0000 7fe5a1782700 1 --2- 172.21.15.57:0/3031784655 >> v2:172.21.15.105:3300/0 conn(0x7fe59c0b1760 0x7fe59c13fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a1f83700 1 -- 172.21.15.57:0/3031784655 >> v2:172.21.15.105:3300/0 conn(0x7fe59c0b1760 msgr2=0x7fe59c13fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/3031784655 >> v2:172.21.15.105:3300/0 conn(0x7fe59c0b1760 0x7fe59c13fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a1f83700 1 -- 172.21.15.57:0/3031784655 >> v1:172.21.15.57:6789/0 conn(0x7fe59c097320 legacy=0x7fe59c097760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a1f83700 1 -- 172.21.15.57:0/3031784655 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c097e70 con 0x7fe59c0701c0 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a0f81700 1 -- 172.21.15.57:0/3031784655 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694343119 0 0) 0x7fe59c13f110 con 0x7fe59c097320 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/3031784655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0701c0 0x7fe59c13f610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0ac430 tx=0x7fe5980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18b958b3fe366ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a0f81700 1 -- 172.21.15.57:0/3031784655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011630 con 0x7fe59c0701c0 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a0f81700 1 -- 172.21.15.57:0/3031784655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598011790 con 0x7fe59c0701c0 2023-10-06T03:55:03.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a0f81700 1 -- 172.21.15.57:0/3031784655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011b30 con 0x7fe59c0701c0 2023-10-06T03:55:03.760 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- 172.21.15.57:0/3031784655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0701c0 msgr2=0x7fe59c13f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/3031784655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0701c0 0x7fe59c13f610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0ac430 tx=0x7fe5980091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- 172.21.15.57:0/3031784655 shutdown_connections 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/3031784655 >> v2:172.21.15.105:3300/0 conn(0x7fe59c0b1760 0x7fe59c13fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/3031784655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0701c0 0x7fe59c13f610 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- 172.21.15.57:0/3031784655 >> 172.21.15.57:0/3031784655 conn(0x7fe59c0b26e0 msgr2=0x7fe59c069290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- 172.21.15.57:0/3031784655 shutdown_connections 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- 172.21.15.57:0/3031784655 wait complete. 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 Processor -- start 2023-10-06T03:55:03.761 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.755+0000 7fe5a41e7700 1 -- start start 2023-10-06T03:55:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 0x7fe59c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 0x7fe59c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c098a60 con 0x7fe59c0b1760 2023-10-06T03:55:03.764 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c099020 con 0x7fe59c097320 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c06d7a0 con 0x7fe59c0701c0 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a2784700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a2784700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41796/0 (socket says 172.21.15.57:41796) 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a2784700 1 -- 172.21.15.57:0/1622583057 learned_addr learned my addr 172.21.15.57:0/1622583057 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 0x7fe59c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1782700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 0x7fe59c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.765 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 -- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 msgr2=0x7fe59c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 0x7fe59c153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 -- 172.21.15.57:0/1622583057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 msgr2=0x7fe59c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 -- 172.21.15.57:0/1622583057 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009420 con 0x7fe59c0701c0 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a2784700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1782700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 0x7fe59c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a1f83700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 0x7fe59c13b410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe598016000 tx=0x7fe598017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598006af0 con 0x7fe59c0701c0 2023-10-06T03:55:03.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c0994b0 con 0x7fe59c0701c0 2023-10-06T03:55:03.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598011900 con 0x7fe59c0701c0 2023-10-06T03:55:03.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598026450 con 0x7fe59c0701c0 2023-10-06T03:55:03.767 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.759+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c06d420 con 0x7fe59c0701c0 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c04be00 con 0x7fe59c0701c0 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fe5980303f0 con 0x7fe59c0701c0 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe591ffb700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 0x7fe580062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7fe59807e1a0 con 0x7fe59c0701c0 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe5a1782700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 0x7fe580062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:03.768 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.763+0000 7fe5a1782700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 0x7fe580062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe59c13ba60 tx=0x7fe58c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:03.776 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.771+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe59804e5d0 con 0x7fe59c0701c0 2023-10-06T03:55:03.939 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.935+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe59c099160 con 0x7fe580060550 2023-10-06T03:55:03.940 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.935+0000 7fe591ffb700 1 -- 172.21.15.57:0/1622583057 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe58c011d10 con 0x7fe580060550 2023-10-06T03:55:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 msgr2=0x7fe580062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 0x7fe580062a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe59c13ba60 tx=0x7fe58c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.942 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 msgr2=0x7fe59c13b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 0x7fe59c13b410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe598016000 tx=0x7fe598017000 comp rx=0 tx=0).stop 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 shutdown_connections 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fe580060550 0x7fe580062a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe59c0b1760 0x7fe59c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe59c097320 0x7fe59c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 --2- 172.21.15.57:0/1622583057 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe59c0701c0 0x7fe59c13b410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 >> 172.21.15.57:0/1622583057 conn(0x7fe59c0b26e0 msgr2=0x7fe59c13f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 shutdown_connections 2023-10-06T03:55:03.943 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:03.939+0000 7fe5a41e7700 1 -- 172.21.15.57:0/1622583057 wait complete. 2023-10-06T03:55:03.944 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:55:03.955 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:55:03.955 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:04.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.059+0000 7fb2a2bad700 1 Processor -- start 2023-10-06T03:55:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.059+0000 7fb2a2bad700 1 -- start start 2023-10-06T03:55:04.065 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb29c13f7a0 0x7fb29c098d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0ab5e0 con 0x7fb29c0b0440 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0a9df0 con 0x7fb29c0992d0 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c0aaee0 con 0x7fb29c13f7a0 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a1bab700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb29c0b0440 0x7fb29c13f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45296/0 (socket says 172.21.15.57:45296) 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a1bab700 1 -- 172.21.15.57:0/523558297 learned_addr learned my addr 172.21.15.57:0/523558297 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:04.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a13aa700 1 --2- 172.21.15.57:0/523558297 >> v2:172.21.15.57:3300/0 conn(0x7fb29c13f7a0 0x7fb29c098d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279799041 0 0) 0x7fb29c0ab5e0 con 0x7fb29c0b0440 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb284003570 con 0x7fb29c0b0440 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445551517 0 0) 0x7fb29c0a9df0 con 0x7fb29c0992d0 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb29c0ab5e0 con 0x7fb29c0992d0 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a13aa700 1 -- 172.21.15.57:0/523558297 >> v1:172.21.15.105:6789/0 conn(0x7fb29c0992d0 legacy=0x7fb29c149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a13aa700 1 -- 172.21.15.57:0/523558297 >> v1:172.21.15.57:6789/0 conn(0x7fb29c0b0440 legacy=0x7fb29c13f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.068 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a13aa700 1 -- 172.21.15.57:0/523558297 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0aa0d0 con 0x7fb29c13f7a0 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a13aa700 1 --2- 172.21.15.57:0/523558297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c13f7a0 0x7fb29c098d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb2900098e0 tx=0x7fb2900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7f185dfc358307 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011630 con 0x7fb29c13f7a0 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290011790 con 0x7fb29c13f7a0 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a0ba9700 1 -- 172.21.15.57:0/523558297 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290011b30 con 0x7fb29c13f7a0 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- 172.21.15.57:0/523558297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c13f7a0 msgr2=0x7fb29c098d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 --2- 172.21.15.57:0/523558297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c13f7a0 0x7fb29c098d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb2900098e0 tx=0x7fb2900091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- 172.21.15.57:0/523558297 shutdown_connections 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 --2- 172.21.15.57:0/523558297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c13f7a0 0x7fb29c098d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- 172.21.15.57:0/523558297 >> 172.21.15.57:0/523558297 conn(0x7fb29c0688d0 msgr2=0x7fb29c068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- 172.21.15.57:0/523558297 shutdown_connections 2023-10-06T03:55:04.069 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.063+0000 7fb2a2bad700 1 -- 172.21.15.57:0/523558297 wait complete. 2023-10-06T03:55:04.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 Processor -- start 2023-10-06T03:55:04.070 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- start start 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0992d0 0x7fb29c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c0b0440 0x7fb29c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c096570 0x7fb29c0969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c06ebc0 con 0x7fb29c096570 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c140780 con 0x7fb29c0b0440 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c140a60 con 0x7fb29c0992d0 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a1bab700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0992d0 0x7fb29c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c096570 0x7fb29c0969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a1bab700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0992d0 0x7fb29c06dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:55066/0 (socket says 172.21.15.57:55066) 2023-10-06T03:55:04.073 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a1bab700 1 -- 172.21.15.57:0/3906192504 learned_addr learned my addr 172.21.15.57:0/3906192504 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a13aa700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c0b0440 0x7fb29c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 -- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0992d0 msgr2=0x7fb29c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb29c0992d0 0x7fb29c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 -- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c0b0440 msgr2=0x7fb29c14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29c0b0440 0x7fb29c14f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290009420 con 0x7fb29c096570 2023-10-06T03:55:04.074 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a23ac700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c096570 0x7fb29c0969e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c560 tx=0x7fb294007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294011590 con 0x7fb29c096570 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294011710 con 0x7fb29c096570 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c0b5600 con 0x7fb29c096570 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294011ad0 con 0x7fb29c096570 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.067+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c14eca0 con 0x7fb29c096570 2023-10-06T03:55:04.075 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb29c06b7b0 con 0x7fb29c096570 2023-10-06T03:55:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fb294012420 con 0x7fb29c096570 2023-10-06T03:55:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb288060580 0x7fb288062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7fb29407c220 con 0x7fb29c096570 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fb288068fb0 0x7fb28806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb28806baf0 con 0x7fb288068fb0 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb29407e860 con 0x7fb29c096570 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.071+0000 7fb2a1bab700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb288060580 0x7fb288062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.077 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.075+0000 7fb2a13aa700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fb288068fb0 0x7fb28806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.075+0000 7fb2a13aa700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fb288068fb0 0x7fb28806b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.075+0000 7fb2a1bab700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb288060580 0x7fb288062a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb28c007e20 tx=0x7fb28c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.079 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.075+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== osd.6 v2:172.21.15.105:6800/33625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb28806baf0 con 0x7fb288068fb0 2023-10-06T03:55:04.097 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 --> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb29c097270 con 0x7fb288068fb0 2023-10-06T03:55:04.098 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb299ffb700 1 -- 172.21.15.57:0/3906192504 <== osd.6 v2:172.21.15.105:6800/33625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb29c097270 con 0x7fb288068fb0 2023-10-06T03:55:04.098 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:04.098 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:04.098 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:04.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fb288068fb0 msgr2=0x7fb28806b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.099 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6800/33625,v1:172.21.15.105:6801/33625] conn(0x7fb288068fb0 0x7fb28806b420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb288060580 msgr2=0x7fb288062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fb288060580 0x7fb288062a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb28c007e20 tx=0x7fb28c009040 comp rx=0 tx=0).stop 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c096570 msgr2=0x7fb29c0969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 --2- 172.21.15.57:0/3906192504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb29c096570 0x7fb29c0969e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c560 tx=0x7fb294007cf0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a23ac700 1 -- 172.21.15.57:0/3906192504 reap_dead start 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 shutdown_connections 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 >> 172.21.15.57:0/3906192504 conn(0x7fb29c0688d0 msgr2=0x7fb29c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 shutdown_connections 2023-10-06T03:55:04.100 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.095+0000 7fb2a2bad700 1 -- 172.21.15.57:0/3906192504 wait complete. 2023-10-06T03:55:04.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:55:04.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 Processor -- start 2023-10-06T03:55:04.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- start start 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99100b49a0 0x7f99100af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100995d0 con 0x7f99100b0bd0 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9910099140 con 0x7f99100b49a0 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910098330 con 0x7f99100afad0 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f99154cb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99100b49a0 0x7f99100af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f99154cb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:55068/0 (socket says 172.21.15.57:55068) 2023-10-06T03:55:04.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f99154cb700 1 -- 172.21.15.57:0/3656942577 learned_addr learned my addr 172.21.15.57:0/3656942577 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 -- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 msgr2=0x7f99100b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:04.229 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 -- 172.21.15.57:0/3656942577 >> v1:172.21.15.105:6789/0 conn(0x7f99100b0bd0 legacy=0x7f99100b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 -- 172.21.15.57:0/3656942577 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910098af0 con 0x7f99100b49a0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f99154cb700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9914cca700 1 -- 172.21.15.57:0/3656942577 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486732144 0 0) 0x7f9900001110 con 0x7f99100b0bd0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9915ccc700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f99100af590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098e0 tx=0x7f990c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=297be29962c4bab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9914cca700 1 -- 172.21.15.57:0/3656942577 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00b640 con 0x7f99100b49a0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9914cca700 1 -- 172.21.15.57:0/3656942577 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00b7a0 con 0x7f99100b49a0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9914cca700 1 -- 172.21.15.57:0/3656942577 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00bb40 con 0x7f99100b49a0 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 msgr2=0x7f99100af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.230 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f99100af590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098e0 tx=0x7f990c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- 172.21.15.57:0/3656942577 shutdown_connections 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100afad0 0x7f99100b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 --2- 172.21.15.57:0/3656942577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f99100af590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- 172.21.15.57:0/3656942577 >> 172.21.15.57:0/3656942577 conn(0x7f991009a040 msgr2=0x7f9910068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- 172.21.15.57:0/3656942577 shutdown_connections 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.223+0000 7f9916cce700 1 -- 172.21.15.57:0/3656942577 wait complete. 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 Processor -- start 2023-10-06T03:55:04.231 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 -- start start 2023-10-06T03:55:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100b0bd0 0x7f9910156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f9910156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100953a0 con 0x7f99100afad0 2023-10-06T03:55:04.233 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910155fa0 con 0x7f99100b49a0 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910095ff0 con 0x7f99100b0bd0 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41826/0 (socket says 172.21.15.57:41826) 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 -- 172.21.15.57:0/2993287832 learned_addr learned my addr 172.21.15.57:0/2993287832 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f99154cb700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100b0bd0 0x7f9910156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f99164cd700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f9910156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 -- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100b0bd0 msgr2=0x7f9910156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100b0bd0 0x7f9910156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 -- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 msgr2=0x7f9910156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f9910156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.234 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 -- 172.21.15.57:0/2993287832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009ae0 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9915ccc700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f991006a290 tx=0x7f990c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00bb20 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c000c90 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c011630 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.226+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990c009420 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.230+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100ab340 con 0x7f99100afad0 2023-10-06T03:55:04.235 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.230+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910068f50 con 0x7f99100afad0 2023-10-06T03:55:04.236 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.234+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f990c0119a0 con 0x7f99100afad0 2023-10-06T03:55:04.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.234+0000 7f9905ffb700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 0x7f98fc062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.234+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f990c07e030 con 0x7f99100afad0 2023-10-06T03:55:04.238 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.234+0000 7f99154cb700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 0x7f98fc062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.239 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.234+0000 7f99154cb700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 0x7f98fc062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99080072d0 tx=0x7f990800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.238+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f990c04e4d0 con 0x7f99100afad0 2023-10-06T03:55:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.402+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f991004b5c0 con 0x7f98fc060580 2023-10-06T03:55:04.407 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.402+0000 7f9905ffb700 1 -- 172.21.15.57:0/2993287832 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f991004b5c0 con 0x7f98fc060580 2023-10-06T03:55:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 msgr2=0x7f98fc062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 0x7f98fc062a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99080072d0 tx=0x7f990800b040 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 msgr2=0x7f9910096a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f991006a290 tx=0x7f990c017000 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 shutdown_connections 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f98fc060580 0x7f98fc062a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99100b49a0 0x7f9910156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99100b0bd0 0x7f9910156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 --2- 172.21.15.57:0/2993287832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99100afad0 0x7f9910096a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 >> 172.21.15.57:0/2993287832 conn(0x7f991009a040 msgr2=0x7f99100b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 shutdown_connections 2023-10-06T03:55:04.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.406+0000 7f9916cce700 1 -- 172.21.15.57:0/2993287832 wait complete. 2023-10-06T03:55:04.413 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:55:04.427 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:55:04.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:55:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.538+0000 7f6a5359e700 1 Processor -- start 2023-10-06T03:55:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.538+0000 7f6a5359e700 1 -- start start 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a540b5a60 0x7f6a5406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a5406dc20 0x7f6a54068550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a54068a90 con 0x7f6a54146360 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540b1e70 con 0x7f6a540b5a60 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a54067b60 con 0x7f6a5406dc20 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a540b5a60 0x7f6a5406cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a4bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6a54146360 0x7f6a5406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45306/0 (socket says 172.21.15.57:45306) 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a4bfff700 1 -- 172.21.15.57:0/3040104280 learned_addr learned my addr 172.21.15.57:0/3040104280 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a540b5a60 0x7f6a5406cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41828/0 (socket says 172.21.15.57:41828) 2023-10-06T03:55:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a52d9d700 1 --2- 172.21.15.57:0/3040104280 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406dc20 0x7f6a54068550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a51d9b700 1 -- 172.21.15.57:0/3040104280 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213066721 0 0) 0x7f6a54068a90 con 0x7f6a54146360 2023-10-06T03:55:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 -- 172.21.15.57:0/3040104280 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406dc20 msgr2=0x7f6a54068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 --2- 172.21.15.57:0/3040104280 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406dc20 0x7f6a54068550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 -- 172.21.15.57:0/3040104280 >> v1:172.21.15.57:6789/0 conn(0x7f6a54146360 legacy=0x7f6a5406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 -- 172.21.15.57:0/3040104280 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5406e0a0 con 0x7f6a540b5a60 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5259c700 1 --2- 172.21.15.57:0/3040104280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a540b5a60 0x7f6a5406cd60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a5406cb60 tx=0x7f6a440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9372e24f69067c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a51d9b700 1 -- 172.21.15.57:0/3040104280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400b6b0 con 0x7f6a540b5a60 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a51d9b700 1 -- 172.21.15.57:0/3040104280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400b810 con 0x7f6a540b5a60 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a51d9b700 1 -- 172.21.15.57:0/3040104280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400bbb0 con 0x7f6a540b5a60 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- 172.21.15.57:0/3040104280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a540b5a60 msgr2=0x7f6a5406cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 --2- 172.21.15.57:0/3040104280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a540b5a60 0x7f6a5406cd60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a5406cb60 tx=0x7f6a440091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- 172.21.15.57:0/3040104280 shutdown_connections 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 --2- 172.21.15.57:0/3040104280 >> v2:172.21.15.105:3300/0 conn(0x7f6a5406dc20 0x7f6a54068550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 --2- 172.21.15.57:0/3040104280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a540b5a60 0x7f6a5406cd60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- 172.21.15.57:0/3040104280 >> 172.21.15.57:0/3040104280 conn(0x7f6a540b2370 msgr2=0x7f6a540b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- 172.21.15.57:0/3040104280 shutdown_connections 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.542+0000 7f6a5359e700 1 -- 172.21.15.57:0/3040104280 wait complete. 2023-10-06T03:55:04.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 Processor -- start 2023-10-06T03:55:04.551 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 -- start start 2023-10-06T03:55:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 0x7f6a54141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a540b5a60 0x7f6a5413f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a54146360 0x7f6a541560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a541422e0 con 0x7f6a5406dc20 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54155c60 con 0x7f6a54146360 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5413ffa0 con 0x7f6a540b5a60 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 0x7f6a54141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 0x7f6a54141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41842/0 (socket says 172.21.15.57:41842) 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 -- 172.21.15.57:0/1804041228 learned_addr learned my addr 172.21.15.57:0/1804041228 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a4bfff700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a540b5a60 0x7f6a5413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a52d9d700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a54146360 0x7f6a541560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 -- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a540b5a60 msgr2=0x7f6a5413f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a540b5a60 0x7f6a5413f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 -- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a54146360 msgr2=0x7f6a541560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.553 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a54146360 0x7f6a541560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44009420 con 0x7f6a5406dc20 2023-10-06T03:55:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a5259c700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 0x7f6a54141da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400b0e0 tx=0x7f6a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.554 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.546+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44000d10 con 0x7f6a5406dc20 2023-10-06T03:55:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400bb90 con 0x7f6a5406dc20 2023-10-06T03:55:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5413fb40 con 0x7f6a5406dc20 2023-10-06T03:55:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011690 con 0x7f6a5406dc20 2023-10-06T03:55:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5413f850 con 0x7f6a5406dc20 2023-10-06T03:55:04.555 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a5406c840 con 0x7f6a5406dc20 2023-10-06T03:55:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6a44011a00 con 0x7f6a5406dc20 2023-10-06T03:55:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a34060550 0x7f6a34062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f6a4407e540 con 0x7f6a5406dc20 2023-10-06T03:55:04.556 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f6a34068e10 0x7f6a3406b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a3406b950 con 0x7f6a34068e10 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a4407e910 con 0x7f6a5406dc20 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a4bfff700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a34060550 0x7f6a34062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.550+0000 7f6a52d9d700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f6a34068e10 0x7f6a3406b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.554+0000 7f6a4bfff700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a34060550 0x7f6a34062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a540adb00 tx=0x7f6a3c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.554+0000 7f6a52d9d700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f6a34068e10 0x7f6a3406b280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.554+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== osd.7 v2:172.21.15.105:6816/33627 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6a3406b950 con 0x7f6a34068e10 2023-10-06T03:55:04.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.570+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 --> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6a540b4bc0 con 0x7f6a34068e10 2023-10-06T03:55:04.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a4a7fc700 1 -- 172.21.15.57:0/1804041228 <== osd.7 v2:172.21.15.105:6816/33627 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6a540b4bc0 con 0x7f6a34068e10 2023-10-06T03:55:04.577 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-10-06T03:55:04.578 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:55:04.578 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f6a34068e10 msgr2=0x7f6a3406b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6816/33627,v1:172.21.15.105:6817/33627] conn(0x7f6a34068e10 0x7f6a3406b280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a34060550 msgr2=0x7f6a34062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6a34060550 0x7f6a34062a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a540adb00 tx=0x7f6a3c007d30 comp rx=0 tx=0).stop 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 msgr2=0x7f6a54141da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 --2- 172.21.15.57:0/1804041228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a5406dc20 0x7f6a54141da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400b0e0 tx=0x7f6a44017000 comp rx=0 tx=0).stop 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a52d9d700 1 -- 172.21.15.57:0/1804041228 reap_dead start 2023-10-06T03:55:04.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 shutdown_connections 2023-10-06T03:55:04.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 >> 172.21.15.57:0/1804041228 conn(0x7f6a540b2370 msgr2=0x7f6a5413bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 shutdown_connections 2023-10-06T03:55:04.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.574+0000 7f6a5359e700 1 -- 172.21.15.57:0/1804041228 wait complete. 2023-10-06T03:55:04.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:55:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.694+0000 7f3d599f1700 1 Processor -- start 2023-10-06T03:55:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- start start 2023-10-06T03:55:04.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d540701c0 0x7f3d540b0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d540b09a0 0x7f3d54067070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d540af960 con 0x7f3d540675b0 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540ac7f0 con 0x7f3d540b09a0 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540aff20 con 0x7f3d540701c0 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d540b09a0 0x7f3d54067070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d591f0700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3d540675b0 0x7f3d5413ce40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45320/0 (socket says 172.21.15.57:45320) 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d591f0700 1 -- 172.21.15.57:0/3038918517 learned_addr learned my addr 172.21.15.57:0/3038918517 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d589ef700 1 --2- 172.21.15.57:0/3038918517 >> v2:172.21.15.105:3300/0 conn(0x7f3d540701c0 0x7f3d540b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 -- 172.21.15.57:0/3038918517 >> v2:172.21.15.105:3300/0 conn(0x7f3d540701c0 msgr2=0x7f3d540b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 --2- 172.21.15.57:0/3038918517 >> v2:172.21.15.105:3300/0 conn(0x7f3d540701c0 0x7f3d540b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 -- 172.21.15.57:0/3038918517 >> v1:172.21.15.57:6789/0 conn(0x7f3d540675b0 legacy=0x7f3d5413ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 -- 172.21.15.57:0/3038918517 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540ac9f0 con 0x7f3d540b09a0 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4bfff700 1 --2- 172.21.15.57:0/3038918517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540b09a0 0x7f3d54067070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d5406a520 tx=0x7f3d440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d3557255d30f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4b7fe700 1 -- 172.21.15.57:0/3038918517 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400b6b0 con 0x7f3d540b09a0 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4b7fe700 1 -- 172.21.15.57:0/3038918517 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400b810 con 0x7f3d540b09a0 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d4b7fe700 1 -- 172.21.15.57:0/3038918517 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400bbb0 con 0x7f3d540b09a0 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- 172.21.15.57:0/3038918517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540b09a0 msgr2=0x7f3d54067070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 --2- 172.21.15.57:0/3038918517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540b09a0 0x7f3d54067070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d5406a520 tx=0x7f3d440091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- 172.21.15.57:0/3038918517 shutdown_connections 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 --2- 172.21.15.57:0/3038918517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540b09a0 0x7f3d54067070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 --2- 172.21.15.57:0/3038918517 >> v2:172.21.15.105:3300/0 conn(0x7f3d540701c0 0x7f3d540b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- 172.21.15.57:0/3038918517 >> 172.21.15.57:0/3038918517 conn(0x7f3d540b1a60 msgr2=0x7f3d540b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- 172.21.15.57:0/3038918517 shutdown_connections 2023-10-06T03:55:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.698+0000 7f3d599f1700 1 -- 172.21.15.57:0/3038918517 wait complete. 2023-10-06T03:55:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 Processor -- start 2023-10-06T03:55:04.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- start start 2023-10-06T03:55:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d540675b0 0x7f3d540a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.707 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d540b09a0 0x7f3d54142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540a7130 con 0x7f3d540701c0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54153d30 con 0x7f3d540675b0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540a7330 con 0x7f3d540b09a0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41864/0 (socket says 172.21.15.57:41864) 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 -- 172.21.15.57:0/1874753884 learned_addr learned my addr 172.21.15.57:0/1874753884 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d589ef700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d540675b0 0x7f3d540a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d591f0700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d540b09a0 0x7f3d54142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 -- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d540b09a0 msgr2=0x7f3d54142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.708 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d540b09a0 0x7f3d54142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 -- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d540675b0 msgr2=0x7f3d540a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d540675b0 0x7f3d540a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.709 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 -- 172.21.15.57:0/1874753884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d44009420 con 0x7f3d540701c0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d4bfff700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d54068080 tx=0x7f3d44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400b980 con 0x7f3d540701c0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400bb00 con 0x7f3d540701c0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d54153730 con 0x7f3d540701c0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44011670 con 0x7f3d540701c0 2023-10-06T03:55:04.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.702+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d541539c0 con 0x7f3d540701c0 2023-10-06T03:55:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3d44011aa0 con 0x7f3d540701c0 2023-10-06T03:55:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54153ec0 con 0x7f3d540701c0 2023-10-06T03:55:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d48ff9700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 0x7f3d40062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:04.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f3d4407e080 con 0x7f3d540701c0 2023-10-06T03:55:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d589ef700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 0x7f3d40062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:04.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.706+0000 7f3d589ef700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 0x7f3d40062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006aa0 tx=0x7f3d50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:04.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.710+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3d4404e4a0 con 0x7f3d540701c0 2023-10-06T03:55:04.882 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.878+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d540b2ef0 con 0x7f3d40060550 2023-10-06T03:55:04.883 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.878+0000 7f3d48ff9700 1 -- 172.21.15.57:0/1874753884 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d540b2ef0 con 0x7f3d40060550 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 msgr2=0x7f3d40062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 0x7f3d40062a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d50006aa0 tx=0x7f3d50008040 comp rx=0 tx=0).stop 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 msgr2=0x7f3d54142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3d54068080 tx=0x7f3d44017000 comp rx=0 tx=0).stop 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 shutdown_connections 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3d40060550 0x7f3d40062a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.886 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d540b09a0 0x7f3d54142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d540701c0 0x7f3d54142120 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 --2- 172.21.15.57:0/1874753884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d540675b0 0x7f3d540a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 >> 172.21.15.57:0/1874753884 conn(0x7f3d540b1a60 msgr2=0x7f3d54068150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 shutdown_connections 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.882+0000 7f3d599f1700 1 -- 172.21.15.57:0/1874753884 wait complete. 2023-10-06T03:55:04.887 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:55:04.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:55:05.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.994+0000 7f669aa1d700 1 Processor -- start 2023-10-06T03:55:05.001 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669aa1d700 1 -- start start 2023-10-06T03:55:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669aa1d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f669406f010 0x7f66940b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669aa1d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66940b1950 con 0x7f669413a6a0 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669aa1d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66940b1300 con 0x7f66940b0e20 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669aa1d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940b1e00 con 0x7f669406f010 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669a21c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f669413a6a0 0x7f6694143a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45332/0 (socket says 172.21.15.57:45332) 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669a21c700 1 -- 172.21.15.57:0/650683550 learned_addr learned my addr 172.21.15.57:0/650683550 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6699a1b700 1 --2- 172.21.15.57:0/650683550 >> v2:172.21.15.57:3300/0 conn(0x7f669406f010 0x7f66940b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331805233 0 0) 0x7f66940b1950 con 0x7f669413a6a0 2023-10-06T03:55:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6680003570 con 0x7f669413a6a0 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713371730 0 0) 0x7f6680003570 con 0x7f669413a6a0 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 >> v2:172.21.15.57:3300/0 conn(0x7f669406f010 msgr2=0x7f66940b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 --2- 172.21.15.57:0/650683550 >> v2:172.21.15.57:3300/0 conn(0x7f669406f010 0x7f66940b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 >> v1:172.21.15.105:6789/0 conn(0x7f66940b0e20 legacy=0x7f6694139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940b15e0 con 0x7f669413a6a0 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f668c0017f0 con 0x7f669413a6a0 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 >> v1:172.21.15.57:6789/0 conn(0x7f669413a6a0 legacy=0x7f6694143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6680003a60 0x7f6680003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f6680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66800051c0 0x7f668000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66940b1e00 con 0x7f6680004810 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668000c160 con 0x7f66800051c0 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668000c320 con 0x7f6680003a60 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f6680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669a21c700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66800051c0 0x7f668000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6699a1b700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6680003a60 0x7f6680003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 -- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6680003a60 msgr2=0x7f6680003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6680003a60 0x7f6680003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 -- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66800051c0 msgr2=0x7f668000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:05.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66800051c0 0x7f668000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669a21c700 1 -- 172.21.15.57:0/650683550 reap_dead start 2023-10-06T03:55:05.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 -- 172.21.15.57:0/650683550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680003570 con 0x7f6680004810 2023-10-06T03:55:05.007 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f669921a700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f6680004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6690001880 tx=0x7f6690007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825db554a2e2f931 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:05.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012420 con 0x7f6680004810 2023-10-06T03:55:05.012 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900125a0 con 0x7f6680004810 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:04.998+0000 7f6698a19700 1 -- 172.21.15.57:0/650683550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012960 con 0x7f6680004810 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 msgr2=0x7f6680004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f6680004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6690001880 tx=0x7f6690007d30 comp rx=0 tx=0).stop 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/650683550 shutdown_connections 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 --2- 172.21.15.57:0/650683550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f6680004c80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/650683550 >> 172.21.15.57:0/650683550 conn(0x7f6694068c20 msgr2=0x7f66940b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/650683550 shutdown_connections 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/650683550 wait complete. 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 Processor -- start 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- start start 2023-10-06T03:55:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6694150130 0x7f66941403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 0x7f6694153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694153190 con 0x7f6680004810 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6694153fe0 con 0x7f6694153620 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6694150690 con 0x7f6694150130 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41884/0 (socket says 172.21.15.57:41884) 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 -- 172.21.15.57:0/1908479011 learned_addr learned my addr 172.21.15.57:0/1908479011 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669a21c700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 0x7f6694153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.014 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669921a700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6694150130 0x7f66941403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 -- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6694150130 msgr2=0x7f66941403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6694150130 0x7f66941403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 -- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 msgr2=0x7f6694153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 0x7f6694153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 -- 172.21.15.57:0/1908479011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694150970 con 0x7f6680004810 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669a21c700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 0x7f6694153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6699a1b700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6684011a40 tx=0x7f66840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400f940 con 0x7f6680004810 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400faa0 con 0x7f6680004810 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66940b5660 con 0x7f6680004810 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400fe20 con 0x7f6680004810 2023-10-06T03:55:05.015 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.002+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694133780 con 0x7f6680004810 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669406bbc0 con 0x7f6680004810 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f6684014650 con 0x7f6680004810 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f6689ffb700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 0x7f6678062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6172+0+0 (secure 0 0 0) 0x7f6684018030 con 0x7f6680004810 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f669921a700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 0x7f6678062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.006+0000 7f669921a700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 0x7f6678062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6690007e40 tx=0x7f6690015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:05.021 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.018+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6684051240 con 0x7f6680004810 2023-10-06T03:55:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.174+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6694150800 con 0x7f6678060550 2023-10-06T03:55:05.193 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.190+0000 7f6689ffb700 1 -- 172.21.15.57:0/1908479011 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312430 (secure 0 0 0) 0x7f6694150800 con 0x7f6678060550 2023-10-06T03:55:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 msgr2=0x7f6678062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 0x7f6678062a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6690007e40 tx=0x7f6690015000 comp rx=0 tx=0).stop 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 msgr2=0x7f669413fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6684011a40 tx=0x7f66840091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 shutdown_connections 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f6678060550 0x7f6678062a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6694153620 0x7f6694153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6694150130 0x7f66941403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.200 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 --2- 172.21.15.57:0/1908479011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6680004810 0x7f669413fe80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 >> 172.21.15.57:0/1908479011 conn(0x7f6694068c20 msgr2=0x7f6694139d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 shutdown_connections 2023-10-06T03:55:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:05.194+0000 7f669aa1d700 1 -- 172.21.15.57:0/1908479011 wait complete. 2023-10-06T03:55:05.201 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:55:05.213 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-10-06T03:55:05.171698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1068577,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":411,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2405,"ondisk_log_size":2405,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403208,"kb_used_data":4424,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571512,"statfs":{"total":773094113280,"available":770633228288,"internally_reserved":0,"allocated":4530176,"data_stored":3030328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64759,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":43,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.519716"},"pg_stats":[{"pgid":"4.3f","version":"27'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.476098+0000","last_change":"2023-10-06T03:55:00.476589+0000","last_active":"2023-10-06T03:55:00.476098+0000","last_peered":"2023-10-06T03:55:00.476098+0000","last_clean":"2023-10-06T03:55:00.476098+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:55:00.476098+0000","last_undegraded":"2023-10-06T03:55:00.476098+0000","last_fullsized":"2023-10-06T03:55:00.476098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072822820000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.3e","version":"27'18","reported_seq":43,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.281590+0000","last_change":"2023-10-06T03:55:01.281634+0000","last_active":"2023-10-06T03:55:01.281590+0000","last_peered":"2023-10-06T03:55:01.281590+0000","last_clean":"2023-10-06T03:55:01.281590+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:55:01.281590+0000","last_undegraded":"2023-10-06T03:55:01.281590+0000","last_fullsized":"2023-10-06T03:55:01.281590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:17:35.840791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0077862729999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"4.3d","version":"27'29","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.655340+0000","last_change":"2023-10-06T03:55:00.655711+0000","last_active":"2023-10-06T03:55:00.655340+0000","last_peered":"2023-10-06T03:55:00.655340+0000","last_clean":"2023-10-06T03:55:00.655340+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:55:00.655340+0000","last_undegraded":"2023-10-06T03:55:00.655340+0000","last_fullsized":"2023-10-06T03:55:00.655340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:45:45.452147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016761273,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.3c","version":"27'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475679+0000","last_change":"2023-10-06T03:55:00.476090+0000","last_active":"2023-10-06T03:55:00.475679+0000","last_peered":"2023-10-06T03:55:00.475679+0000","last_clean":"2023-10-06T03:55:00.475679+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:55:00.475679+0000","last_undegraded":"2023-10-06T03:55:00.475679+0000","last_fullsized":"2023-10-06T03:55:00.475679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:52.393067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063584109999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.3b","version":"27'21","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.763175+0000","last_change":"2023-10-06T03:55:00.763536+0000","last_active":"2023-10-06T03:55:00.763175+0000","last_peered":"2023-10-06T03:55:00.763175+0000","last_clean":"2023-10-06T03:55:00.763175+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:55:00.763175+0000","last_undegraded":"2023-10-06T03:55:00.763175+0000","last_fullsized":"2023-10-06T03:55:00.763175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010010550999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.3a","version":"27'23","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.654447+0000","last_change":"2023-10-06T03:55:00.654853+0000","last_active":"2023-10-06T03:55:00.654447+0000","last_peered":"2023-10-06T03:55:00.654447+0000","last_clean":"2023-10-06T03:55:00.654447+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:55:00.654447+0000","last_undegraded":"2023-10-06T03:55:00.654447+0000","last_fullsized":"2023-10-06T03:55:00.654447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:13:27.762639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017107009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.39","version":"27'22","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.479095+0000","last_change":"2023-10-06T03:55:00.479572+0000","last_active":"2023-10-06T03:55:00.479095+0000","last_peered":"2023-10-06T03:55:00.479095+0000","last_clean":"2023-10-06T03:55:00.479095+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:55:00.479095+0000","last_undegraded":"2023-10-06T03:55:00.479095+0000","last_fullsized":"2023-10-06T03:55:00.479095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044403079999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.38","version":"27'28","reported_seq":53,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.280997+0000","last_change":"2023-10-06T03:55:01.281028+0000","last_active":"2023-10-06T03:55:01.280997+0000","last_peered":"2023-10-06T03:55:01.280997+0000","last_clean":"2023-10-06T03:55:01.280997+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:55:01.280997+0000","last_undegraded":"2023-10-06T03:55:01.280997+0000","last_fullsized":"2023-10-06T03:55:01.280997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:19.152239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086251880000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"4.37","version":"27'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.763466+0000","last_change":"2023-10-06T03:55:00.763893+0000","last_active":"2023-10-06T03:55:00.763466+0000","last_peered":"2023-10-06T03:55:00.763466+0000","last_clean":"2023-10-06T03:55:00.763466+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:55:00.763466+0000","last_undegraded":"2023-10-06T03:55:00.763466+0000","last_fullsized":"2023-10-06T03:55:00.763466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092769180000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.36","version":"27'58","reported_seq":81,"reported_epoch":28,"state":"active+clean+snaptrim","last_fresh":"2023-10-06T03:55:01.282094+0000","last_change":"2023-10-06T03:55:01.282131+0000","last_active":"2023-10-06T03:55:01.282094+0000","last_peered":"2023-10-06T03:55:01.282094+0000","last_clean":"2023-10-06T03:55:01.282094+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:55:01.282094+0000","last_undegraded":"2023-10-06T03:55:01.282094+0000","last_fullsized":"2023-10-06T03:55:01.282094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:36:28.300000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065493319999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"4.35","version":"27'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.656433+0000","last_change":"2023-10-06T03:55:00.656685+0000","last_active":"2023-10-06T03:55:00.656433+0000","last_peered":"2023-10-06T03:55:00.656433+0000","last_clean":"2023-10-06T03:55:00.656433+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:55:00.656433+0000","last_undegraded":"2023-10-06T03:55:00.656433+0000","last_fullsized":"2023-10-06T03:55:00.656433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017044597000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.34","version":"27'27","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475485+0000","last_change":"2023-10-06T03:55:00.475981+0000","last_active":"2023-10-06T03:55:00.475485+0000","last_peered":"2023-10-06T03:55:00.475485+0000","last_clean":"2023-10-06T03:55:00.475485+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:55:00.475485+0000","last_undegraded":"2023-10-06T03:55:00.475485+0000","last_fullsized":"2023-10-06T03:55:00.475485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069042510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.33","version":"27'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.474930+0000","last_change":"2023-10-06T03:55:00.475400+0000","last_active":"2023-10-06T03:55:00.474930+0000","last_peered":"2023-10-06T03:55:00.474930+0000","last_clean":"2023-10-06T03:55:00.474930+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:55:00.474930+0000","last_undegraded":"2023-10-06T03:55:00.474930+0000","last_fullsized":"2023-10-06T03:55:00.474930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:36.314025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006884589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.32","version":"27'36","reported_seq":61,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.282054+0000","last_change":"2023-10-06T03:55:01.282117+0000","last_active":"2023-10-06T03:55:01.282054+0000","last_peered":"2023-10-06T03:55:01.282054+0000","last_clean":"2023-10-06T03:55:01.282054+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:55:01.282054+0000","last_undegraded":"2023-10-06T03:55:01.282054+0000","last_fullsized":"2023-10-06T03:55:01.282054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:32.291940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079481929999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"4.31","version":"27'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.479235+0000","last_change":"2023-10-06T03:55:00.479621+0000","last_active":"2023-10-06T03:55:00.479235+0000","last_peered":"2023-10-06T03:55:00.479235+0000","last_clean":"2023-10-06T03:55:00.479235+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:55:00.479235+0000","last_undegraded":"2023-10-06T03:55:00.479235+0000","last_fullsized":"2023-10-06T03:55:00.479235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042743499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.30","version":"27'40","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.653340+0000","last_change":"2023-10-06T03:55:00.653680+0000","last_active":"2023-10-06T03:55:00.653340+0000","last_peered":"2023-10-06T03:55:00.653340+0000","last_clean":"2023-10-06T03:55:00.653340+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:55:00.653340+0000","last_undegraded":"2023-10-06T03:55:00.653340+0000","last_fullsized":"2023-10-06T03:55:00.653340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016525431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2f","version":"27'32","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.764112+0000","last_change":"2023-10-06T03:55:00.764584+0000","last_active":"2023-10-06T03:55:00.764112+0000","last_peered":"2023-10-06T03:55:00.764112+0000","last_clean":"2023-10-06T03:55:00.764112+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:55:00.764112+0000","last_undegraded":"2023-10-06T03:55:00.764112+0000","last_fullsized":"2023-10-06T03:55:00.764112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:06.190393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096482700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2e","version":"27'49","reported_seq":77,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.656562+0000","last_change":"2023-10-06T03:55:00.656823+0000","last_active":"2023-10-06T03:55:00.656562+0000","last_peered":"2023-10-06T03:55:00.656562+0000","last_clean":"2023-10-06T03:55:00.656562+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:55:00.656562+0000","last_undegraded":"2023-10-06T03:55:00.656562+0000","last_fullsized":"2023-10-06T03:55:00.656562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171402999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2d","version":"27'30","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475049+0000","last_change":"2023-10-06T03:55:00.475483+0000","last_active":"2023-10-06T03:55:00.475049+0000","last_peered":"2023-10-06T03:55:00.475049+0000","last_clean":"2023-10-06T03:55:00.475049+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:55:00.475049+0000","last_undegraded":"2023-10-06T03:55:00.475049+0000","last_fullsized":"2023-10-06T03:55:00.475049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:05.607695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063946960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2c","version":"27'35","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.655773+0000","last_change":"2023-10-06T03:55:00.656042+0000","last_active":"2023-10-06T03:55:00.655773+0000","last_peered":"2023-10-06T03:55:00.655773+0000","last_clean":"2023-10-06T03:55:00.655773+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:55:00.655773+0000","last_undegraded":"2023-10-06T03:55:00.655773+0000","last_fullsized":"2023-10-06T03:55:00.655773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:00:00.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017011842999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2b","version":"27'44","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.479667+0000","last_change":"2023-10-06T03:55:00.480023+0000","last_active":"2023-10-06T03:55:00.479667+0000","last_peered":"2023-10-06T03:55:00.479667+0000","last_clean":"2023-10-06T03:55:00.479667+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:55:00.479667+0000","last_undegraded":"2023-10-06T03:55:00.479667+0000","last_fullsized":"2023-10-06T03:55:00.479667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045883720000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.2a","version":"27'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.763601+0000","last_change":"2023-10-06T03:55:00.764066+0000","last_active":"2023-10-06T03:55:00.763601+0000","last_peered":"2023-10-06T03:55:00.763601+0000","last_clean":"2023-10-06T03:55:00.763601+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:55:00.763601+0000","last_undegraded":"2023-10-06T03:55:00.763601+0000","last_fullsized":"2023-10-06T03:55:00.763601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:14:13.933604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010470313,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.29","version":"27'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.780933+0000","last_change":"2023-10-06T03:55:00.781344+0000","last_active":"2023-10-06T03:55:00.780933+0000","last_peered":"2023-10-06T03:55:00.780933+0000","last_clean":"2023-10-06T03:55:00.780933+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:55:00.780933+0000","last_undegraded":"2023-10-06T03:55:00.780933+0000","last_fullsized":"2023-10-06T03:55:00.780933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092240970000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.28","version":"27'31","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.478845+0000","last_change":"2023-10-06T03:55:00.479157+0000","last_active":"2023-10-06T03:55:00.478845+0000","last_peered":"2023-10-06T03:55:00.478845+0000","last_clean":"2023-10-06T03:55:00.478845+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:55:00.478845+0000","last_undegraded":"2023-10-06T03:55:00.478845+0000","last_fullsized":"2023-10-06T03:55:00.478845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042144280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.27","version":"27'20","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.539979+0000","last_change":"2023-10-06T03:55:00.540395+0000","last_active":"2023-10-06T03:55:00.539979+0000","last_peered":"2023-10-06T03:55:00.539979+0000","last_clean":"2023-10-06T03:55:00.539979+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:55:00.539979+0000","last_undegraded":"2023-10-06T03:55:00.539979+0000","last_fullsized":"2023-10-06T03:55:00.539979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010852538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.26","version":"27'53","reported_seq":81,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.539600+0000","last_change":"2023-10-06T03:55:00.539935+0000","last_active":"2023-10-06T03:55:00.539600+0000","last_peered":"2023-10-06T03:55:00.539600+0000","last_clean":"2023-10-06T03:55:00.539600+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:55:00.539600+0000","last_undegraded":"2023-10-06T03:55:00.539600+0000","last_fullsized":"2023-10-06T03:55:00.539600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096577650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.25","version":"27'26","reported_seq":51,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.281563+0000","last_change":"2023-10-06T03:55:01.281609+0000","last_active":"2023-10-06T03:55:01.281563+0000","last_peered":"2023-10-06T03:55:01.281563+0000","last_clean":"2023-10-06T03:55:01.281563+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:55:01.281563+0000","last_undegraded":"2023-10-06T03:55:01.281563+0000","last_fullsized":"2023-10-06T03:55:01.281563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:29.629278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078079719999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"4.24","version":"27'19","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.540547+0000","last_change":"2023-10-06T03:55:00.541029+0000","last_active":"2023-10-06T03:55:00.540547+0000","last_peered":"2023-10-06T03:55:00.540547+0000","last_clean":"2023-10-06T03:55:00.540547+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:55:00.540547+0000","last_undegraded":"2023-10-06T03:55:00.540547+0000","last_fullsized":"2023-10-06T03:55:00.540547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:40.078875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010385257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.23","version":"27'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.784400+0000","last_change":"2023-10-06T03:55:00.784773+0000","last_active":"2023-10-06T03:55:00.784400+0000","last_peered":"2023-10-06T03:55:00.784400+0000","last_clean":"2023-10-06T03:55:00.784400+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:55:00.784400+0000","last_undegraded":"2023-10-06T03:55:00.784400+0000","last_fullsized":"2023-10-06T03:55:00.784400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:39:29.741499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091510959999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.22","version":"27'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.654906+0000","last_change":"2023-10-06T03:55:00.655227+0000","last_active":"2023-10-06T03:55:00.654906+0000","last_peered":"2023-10-06T03:55:00.654906+0000","last_clean":"2023-10-06T03:55:00.654906+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:55:00.654906+0000","last_undegraded":"2023-10-06T03:55:00.654906+0000","last_fullsized":"2023-10-06T03:55:00.654906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:57:12.957692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017042165000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.21","version":"27'43","reported_seq":71,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.782549+0000","last_change":"2023-10-06T03:55:00.782891+0000","last_active":"2023-10-06T03:55:00.782549+0000","last_peered":"2023-10-06T03:55:00.782549+0000","last_clean":"2023-10-06T03:55:00.782549+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:55:00.782549+0000","last_undegraded":"2023-10-06T03:55:00.782549+0000","last_fullsized":"2023-10-06T03:55:00.782549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010478619,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.20","version":"27'35","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475961+0000","last_change":"2023-10-06T03:55:00.476360+0000","last_active":"2023-10-06T03:55:00.475961+0000","last_peered":"2023-10-06T03:55:00.475961+0000","last_clean":"2023-10-06T03:55:00.475961+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:55:00.475961+0000","last_undegraded":"2023-10-06T03:55:00.475961+0000","last_fullsized":"2023-10-06T03:55:00.475961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:24.246128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007180461,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.14","version":"27'44","reported_seq":72,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.783465+0000","last_change":"2023-10-06T03:55:00.783861+0000","last_active":"2023-10-06T03:55:00.783465+0000","last_peered":"2023-10-06T03:55:00.783465+0000","last_clean":"2023-10-06T03:55:00.783465+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:55:00.783465+0000","last_undegraded":"2023-10-06T03:55:00.783465+0000","last_fullsized":"2023-10-06T03:55:00.783465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010865144,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.13","version":"27'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.703170+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:54:46.703170+0000","last_peered":"2023-10-06T03:54:46.703170+0000","last_clean":"2023-10-06T03:54:46.703170+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:54:46.703170+0000","last_undegraded":"2023-10-06T03:54:46.703170+0000","last_fullsized":"2023-10-06T03:54:46.703170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:37.399065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'30","reported_seq":55,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.282049+0000","last_change":"2023-10-06T03:55:01.282105+0000","last_active":"2023-10-06T03:55:01.282049+0000","last_peered":"2023-10-06T03:55:01.282049+0000","last_clean":"2023-10-06T03:55:01.282049+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:55:01.282049+0000","last_undegraded":"2023-10-06T03:55:01.282049+0000","last_fullsized":"2023-10-06T03:55:01.282049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:13:30.138630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007869727,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.12","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:49.698742+0000","last_change":"2023-10-06T03:53:43.655832+0000","last_active":"2023-10-06T03:54:49.698742+0000","last_peered":"2023-10-06T03:54:49.698742+0000","last_clean":"2023-10-06T03:54:49.698742+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:54:49.698742+0000","last_undegraded":"2023-10-06T03:54:49.698742+0000","last_fullsized":"2023-10-06T03:54:49.698742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.764636+0000","last_change":"2023-10-06T03:55:00.765130+0000","last_active":"2023-10-06T03:55:00.764636+0000","last_peered":"2023-10-06T03:55:00.764636+0000","last_clean":"2023-10-06T03:55:00.764636+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:55:00.764636+0000","last_undegraded":"2023-10-06T03:55:00.764636+0000","last_fullsized":"2023-10-06T03:55:00.764636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097705469999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511707+0000","last_change":"2023-10-06T03:53:43.656717+0000","last_active":"2023-10-06T03:54:27.511707+0000","last_peered":"2023-10-06T03:54:27.511707+0000","last_clean":"2023-10-06T03:54:27.511707+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:54:27.511707+0000","last_undegraded":"2023-10-06T03:54:27.511707+0000","last_fullsized":"2023-10-06T03:54:27.511707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:23.241514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.784045+0000","last_change":"2023-10-06T03:55:00.784450+0000","last_active":"2023-10-06T03:55:00.784045+0000","last_peered":"2023-10-06T03:55:00.784045+0000","last_clean":"2023-10-06T03:55:00.784045+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:55:00.784045+0000","last_undegraded":"2023-10-06T03:55:00.784045+0000","last_fullsized":"2023-10-06T03:55:00.784045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:30.023113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01003823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.10","version":"27'9","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.702686+0000","last_change":"2023-10-06T03:53:43.660638+0000","last_active":"2023-10-06T03:54:46.702686+0000","last_peered":"2023-10-06T03:54:46.702686+0000","last_clean":"2023-10-06T03:54:46.702686+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:54:46.702686+0000","last_undegraded":"2023-10-06T03:54:46.702686+0000","last_fullsized":"2023-10-06T03:54:46.702686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.512394+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:54:27.512394+0000","last_peered":"2023-10-06T03:54:27.512394+0000","last_clean":"2023-10-06T03:54:27.512394+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:54:27.512394+0000","last_undegraded":"2023-10-06T03:54:27.512394+0000","last_fullsized":"2023-10-06T03:54:27.512394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:39.573287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'34","reported_seq":57,"reported_epoch":28,"state":"active+clean+snaptrim","last_fresh":"2023-10-06T03:55:01.282154+0000","last_change":"2023-10-06T03:55:01.282172+0000","last_active":"2023-10-06T03:55:01.282154+0000","last_peered":"2023-10-06T03:55:01.282154+0000","last_clean":"2023-10-06T03:55:01.282154+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:55:01.282154+0000","last_undegraded":"2023-10-06T03:55:01.282154+0000","last_fullsized":"2023-10-06T03:55:01.282154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:20.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058719740000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"2"}]},{"pgid":"3.e","version":"24'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.512436+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:54:27.512436+0000","last_peered":"2023-10-06T03:54:27.512436+0000","last_clean":"2023-10-06T03:54:27.512436+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:54:27.512436+0000","last_undegraded":"2023-10-06T03:54:27.512436+0000","last_fullsized":"2023-10-06T03:54:27.512436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'10","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.653913+0000","last_change":"2023-10-06T03:55:00.654289+0000","last_active":"2023-10-06T03:55:00.653913+0000","last_peered":"2023-10-06T03:55:00.653913+0000","last_clean":"2023-10-06T03:55:00.653913+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:55:00.653913+0000","last_undegraded":"2023-10-06T03:55:00.653913+0000","last_fullsized":"2023-10-06T03:55:00.653913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:54:38.151060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016897651999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.d","version":"24'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.512229+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:54:27.512229+0000","last_peered":"2023-10-06T03:54:27.512229+0000","last_clean":"2023-10-06T03:54:27.512229+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:54:27.512229+0000","last_undegraded":"2023-10-06T03:54:27.512229+0000","last_fullsized":"2023-10-06T03:54:27.512229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:42.252270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'24","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475145+0000","last_change":"2023-10-06T03:55:00.475712+0000","last_active":"2023-10-06T03:55:00.475145+0000","last_peered":"2023-10-06T03:55:00.475145+0000","last_clean":"2023-10-06T03:55:00.475145+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:55:00.475145+0000","last_undegraded":"2023-10-06T03:55:00.475145+0000","last_fullsized":"2023-10-06T03:55:00.475145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:43.256884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063459989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.c","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.702763+0000","last_change":"2023-10-06T03:53:43.667897+0000","last_active":"2023-10-06T03:54:46.702763+0000","last_peered":"2023-10-06T03:54:46.702763+0000","last_clean":"2023-10-06T03:54:46.702763+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:54:46.702763+0000","last_undegraded":"2023-10-06T03:54:46.702763+0000","last_fullsized":"2023-10-06T03:54:46.702763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:33.821822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'39","reported_seq":67,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.761824+0000","last_change":"2023-10-06T03:55:00.762223+0000","last_active":"2023-10-06T03:55:00.761824+0000","last_peered":"2023-10-06T03:55:00.761824+0000","last_clean":"2023-10-06T03:55:00.761824+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:55:00.761824+0000","last_undegraded":"2023-10-06T03:55:00.761824+0000","last_fullsized":"2023-10-06T03:55:00.761824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091432119999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.b","version":"27'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.686975+0000","last_change":"2023-10-06T03:53:43.667052+0000","last_active":"2023-10-06T03:54:46.686975+0000","last_peered":"2023-10-06T03:54:46.686975+0000","last_clean":"2023-10-06T03:54:46.686975+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:54:46.686975+0000","last_undegraded":"2023-10-06T03:54:46.686975+0000","last_fullsized":"2023-10-06T03:54:46.686975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:04.603081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'29","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.656064+0000","last_change":"2023-10-06T03:55:00.656394+0000","last_active":"2023-10-06T03:55:00.656064+0000","last_peered":"2023-10-06T03:55:00.656064+0000","last_clean":"2023-10-06T03:55:00.656064+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:55:00.656064+0000","last_undegraded":"2023-10-06T03:55:00.656064+0000","last_fullsized":"2023-10-06T03:55:00.656064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:25.439966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017145036999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.a","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.700055+0000","last_change":"2023-10-06T03:53:43.653536+0000","last_active":"2023-10-06T03:54:46.700055+0000","last_peered":"2023-10-06T03:54:46.700055+0000","last_clean":"2023-10-06T03:54:46.700055+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:54:46.700055+0000","last_undegraded":"2023-10-06T03:54:46.700055+0000","last_fullsized":"2023-10-06T03:54:46.700055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'29","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.656124+0000","last_change":"2023-10-06T03:55:00.656528+0000","last_active":"2023-10-06T03:55:00.656124+0000","last_peered":"2023-10-06T03:55:00.656124+0000","last_clean":"2023-10-06T03:55:00.656124+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:55:00.656124+0000","last_undegraded":"2023-10-06T03:55:00.656124+0000","last_fullsized":"2023-10-06T03:55:00.656124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017135524999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.9","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:56.705411+0000","last_change":"2023-10-06T03:53:43.645336+0000","last_active":"2023-10-06T03:54:56.705411+0000","last_peered":"2023-10-06T03:54:56.705411+0000","last_clean":"2023-10-06T03:54:56.705411+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:54:56.705411+0000","last_undegraded":"2023-10-06T03:54:56.705411+0000","last_fullsized":"2023-10-06T03:54:56.705411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.656723+0000","last_change":"2023-10-06T03:55:00.657069+0000","last_active":"2023-10-06T03:55:00.656723+0000","last_peered":"2023-10-06T03:55:00.656723+0000","last_clean":"2023-10-06T03:55:00.656723+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:55:00.656723+0000","last_undegraded":"2023-10-06T03:55:00.656723+0000","last_fullsized":"2023-10-06T03:55:00.656723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:04:19.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017297254000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.8","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.704593+0000","last_change":"2023-10-06T03:53:43.657330+0000","last_active":"2023-10-06T03:54:46.704593+0000","last_peered":"2023-10-06T03:54:46.704593+0000","last_clean":"2023-10-06T03:54:46.704593+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:54:46.704593+0000","last_undegraded":"2023-10-06T03:54:46.704593+0000","last_fullsized":"2023-10-06T03:54:46.704593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'35","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.539504+0000","last_change":"2023-10-06T03:55:00.539918+0000","last_active":"2023-10-06T03:55:00.539504+0000","last_peered":"2023-10-06T03:55:00.539504+0000","last_clean":"2023-10-06T03:55:00.539504+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:55:00.539504+0000","last_undegraded":"2023-10-06T03:55:00.539504+0000","last_fullsized":"2023-10-06T03:55:00.539504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:43:41.500821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099655790000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511377+0000","last_change":"2023-10-06T03:53:34.869751+0000","last_active":"2023-10-06T03:54:27.511377+0000","last_peered":"2023-10-06T03:54:27.511377+0000","last_clean":"2023-10-06T03:54:27.511377+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:54:27.511377+0000","last_undegraded":"2023-10-06T03:54:27.511377+0000","last_fullsized":"2023-10-06T03:54:27.511377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:33.296006+0000","last_clean_scrub_stamp":"2023-10-06T03:53:33.296006+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:22.403779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322466+0000","last_change":"2023-10-06T03:53:39.498762+0000","last_active":"2023-10-06T03:54:26.322466+0000","last_peered":"2023-10-06T03:54:26.322466+0000","last_clean":"2023-10-06T03:54:26.322466+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:54:26.322466+0000","last_undegraded":"2023-10-06T03:54:26.322466+0000","last_fullsized":"2023-10-06T03:54:26.322466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:00:27.341282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318793+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:54:26.318793+0000","last_peered":"2023-10-06T03:54:26.318793+0000","last_clean":"2023-10-06T03:54:26.318793+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:54:26.318793+0000","last_undegraded":"2023-10-06T03:54:26.318793+0000","last_fullsized":"2023-10-06T03:54:26.318793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.476426+0000","last_change":"2023-10-06T03:55:00.476831+0000","last_active":"2023-10-06T03:55:00.476426+0000","last_peered":"2023-10-06T03:55:00.476426+0000","last_clean":"2023-10-06T03:55:00.476426+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:55:00.476426+0000","last_undegraded":"2023-10-06T03:55:00.476426+0000","last_fullsized":"2023-10-06T03:55:00.476426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:44:38.403679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006907687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.510543+0000","last_change":"2023-10-06T03:53:39.498683+0000","last_active":"2023-10-06T03:54:27.510543+0000","last_peered":"2023-10-06T03:54:27.510543+0000","last_clean":"2023-10-06T03:54:27.510543+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:54:27.510543+0000","last_undegraded":"2023-10-06T03:54:27.510543+0000","last_fullsized":"2023-10-06T03:54:27.510543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:16.207722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:58.705677+0000","last_change":"2023-10-06T03:53:43.655229+0000","last_active":"2023-10-06T03:54:58.705677+0000","last_peered":"2023-10-06T03:54:58.705677+0000","last_clean":"2023-10-06T03:54:58.705677+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:54:58.705677+0000","last_undegraded":"2023-10-06T03:54:58.705677+0000","last_fullsized":"2023-10-06T03:54:58.705677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'35","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.764386+0000","last_change":"2023-10-06T03:55:00.764686+0000","last_active":"2023-10-06T03:55:00.764386+0000","last_peered":"2023-10-06T03:55:00.764386+0000","last_clean":"2023-10-06T03:55:00.764386+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:55:00.764386+0000","last_undegraded":"2023-10-06T03:55:00.764386+0000","last_fullsized":"2023-10-06T03:55:00.764386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0095532519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.781564+0000","last_change":"2023-10-06T03:53:39.604394+0000","last_active":"2023-10-06T03:54:26.781564+0000","last_peered":"2023-10-06T03:54:26.781564+0000","last_clean":"2023-10-06T03:54:26.781564+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:54:26.781564+0000","last_undegraded":"2023-10-06T03:54:26.781564+0000","last_fullsized":"2023-10-06T03:54:26.781564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.701759+0000","last_change":"2023-10-06T03:53:43.648693+0000","last_active":"2023-10-06T03:54:46.701759+0000","last_peered":"2023-10-06T03:54:46.701759+0000","last_clean":"2023-10-06T03:54:46.701759+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:54:46.701759+0000","last_undegraded":"2023-10-06T03:54:46.701759+0000","last_fullsized":"2023-10-06T03:54:46.701759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'28","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.540466+0000","last_change":"2023-10-06T03:55:00.540927+0000","last_active":"2023-10-06T03:55:00.540466+0000","last_peered":"2023-10-06T03:55:00.540466+0000","last_clean":"2023-10-06T03:55:00.540466+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:55:00.540466+0000","last_undegraded":"2023-10-06T03:55:00.540466+0000","last_fullsized":"2023-10-06T03:55:00.540466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:42.365255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010907283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322583+0000","last_change":"2023-10-06T03:53:39.499498+0000","last_active":"2023-10-06T03:54:26.322583+0000","last_peered":"2023-10-06T03:54:26.322583+0000","last_clean":"2023-10-06T03:54:26.322583+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:54:26.322583+0000","last_undegraded":"2023-10-06T03:54:26.322583+0000","last_fullsized":"2023-10-06T03:54:26.322583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:51:33.897347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.317784+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:54:26.317784+0000","last_peered":"2023-10-06T03:54:26.317784+0000","last_clean":"2023-10-06T03:54:26.317784+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:54:26.317784+0000","last_undegraded":"2023-10-06T03:54:26.317784+0000","last_fullsized":"2023-10-06T03:54:26.317784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'35","reported_seq":58,"reported_epoch":28,"state":"active+clean+snaptrim_wait","last_fresh":"2023-10-06T03:55:01.281079+0000","last_change":"2023-10-06T03:55:01.281135+0000","last_active":"2023-10-06T03:55:01.281079+0000","last_peered":"2023-10-06T03:55:01.281079+0000","last_clean":"2023-10-06T03:55:01.281079+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:55:01.281079+0000","last_undegraded":"2023-10-06T03:55:01.281079+0000","last_fullsized":"2023-10-06T03:55:01.281079+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:52.067892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0082231560000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.5","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:56.705778+0000","last_change":"2023-10-06T03:53:43.667801+0000","last_active":"2023-10-06T03:54:56.705778+0000","last_peered":"2023-10-06T03:54:56.705778+0000","last_clean":"2023-10-06T03:54:56.705778+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:54:56.705778+0000","last_undegraded":"2023-10-06T03:54:56.705778+0000","last_fullsized":"2023-10-06T03:54:56.705778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:58:10.102497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.164283+0000","last_change":"2023-10-06T03:53:39.500488+0000","last_active":"2023-10-06T03:54:27.164283+0000","last_peered":"2023-10-06T03:54:27.164283+0000","last_clean":"2023-10-06T03:54:27.164283+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:54:27.164283+0000","last_undegraded":"2023-10-06T03:54:27.164283+0000","last_fullsized":"2023-10-06T03:54:27.164283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:44:19.112843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.541007+0000","last_change":"2023-10-06T03:55:00.541459+0000","last_active":"2023-10-06T03:55:00.541007+0000","last_peered":"2023-10-06T03:55:00.541007+0000","last_clean":"2023-10-06T03:55:00.541007+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:55:00.541007+0000","last_undegraded":"2023-10-06T03:55:00.541007+0000","last_fullsized":"2023-10-06T03:55:00.541007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010698005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.164112+0000","last_change":"2023-10-06T03:53:43.656678+0000","last_active":"2023-10-06T03:54:27.164112+0000","last_peered":"2023-10-06T03:54:27.164112+0000","last_clean":"2023-10-06T03:54:27.164112+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:54:27.164112+0000","last_undegraded":"2023-10-06T03:54:27.164112+0000","last_fullsized":"2023-10-06T03:54:27.164112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.510625+0000","last_change":"2023-10-06T03:53:39.493734+0000","last_active":"2023-10-06T03:54:27.510625+0000","last_peered":"2023-10-06T03:54:27.510625+0000","last_clean":"2023-10-06T03:54:27.510625+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:54:27.510625+0000","last_undegraded":"2023-10-06T03:54:27.510625+0000","last_fullsized":"2023-10-06T03:54:27.510625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:40.808499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'25","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.762049+0000","last_change":"2023-10-06T03:55:00.762424+0000","last_active":"2023-10-06T03:55:00.762049+0000","last_peered":"2023-10-06T03:55:00.762049+0000","last_clean":"2023-10-06T03:55:00.762049+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:55:00.762049+0000","last_undegraded":"2023-10-06T03:55:00.762049+0000","last_fullsized":"2023-10-06T03:55:00.762049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093781690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.7","version":"27'3","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.703823+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:54:46.703823+0000","last_peered":"2023-10-06T03:54:46.703823+0000","last_clean":"2023-10-06T03:54:46.703823+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:54:46.703823+0000","last_undegraded":"2023-10-06T03:54:46.703823+0000","last_fullsized":"2023-10-06T03:54:46.703823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:28.758890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.164176+0000","last_change":"2023-10-06T03:53:39.499371+0000","last_active":"2023-10-06T03:54:27.164176+0000","last_peered":"2023-10-06T03:54:27.164176+0000","last_clean":"2023-10-06T03:54:27.164176+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:54:27.164176+0000","last_undegraded":"2023-10-06T03:54:27.164176+0000","last_fullsized":"2023-10-06T03:54:27.164176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'38","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.783594+0000","last_change":"2023-10-06T03:55:00.783968+0000","last_active":"2023-10-06T03:55:00.783594+0000","last_peered":"2023-10-06T03:55:00.783594+0000","last_clean":"2023-10-06T03:55:00.783594+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:55:00.783594+0000","last_undegraded":"2023-10-06T03:55:00.783594+0000","last_fullsized":"2023-10-06T03:55:00.783594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.097639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010244603,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.6","version":"27'5","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:59.597036+0000","last_change":"2023-10-06T03:53:43.662070+0000","last_active":"2023-10-06T03:54:59.597036+0000","last_peered":"2023-10-06T03:54:59.597036+0000","last_clean":"2023-10-06T03:54:59.597036+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:54:59.597036+0000","last_undegraded":"2023-10-06T03:54:59.597036+0000","last_fullsized":"2023-10-06T03:54:59.597036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:27.511931+0000","last_change":"2023-10-06T03:53:39.491844+0000","last_active":"2023-10-06T03:54:27.511931+0000","last_peered":"2023-10-06T03:54:27.511931+0000","last_clean":"2023-10-06T03:54:27.511931+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:54:27.511931+0000","last_undegraded":"2023-10-06T03:54:27.511931+0000","last_fullsized":"2023-10-06T03:54:27.511931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:38.452339+0000","last_clean_scrub_stamp":"2023-10-06T03:53:38.452339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:34.415589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'21","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.654360+0000","last_change":"2023-10-06T03:55:00.654717+0000","last_active":"2023-10-06T03:55:00.654360+0000","last_peered":"2023-10-06T03:55:00.654360+0000","last_clean":"2023-10-06T03:55:00.654360+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:55:00.654360+0000","last_undegraded":"2023-10-06T03:55:00.654360+0000","last_fullsized":"2023-10-06T03:55:00.654360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:25.113559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171291000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.13","version":"27'61","reported_seq":89,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.655196+0000","last_change":"2023-10-06T03:55:00.655609+0000","last_active":"2023-10-06T03:55:00.655196+0000","last_peered":"2023-10-06T03:55:00.655196+0000","last_clean":"2023-10-06T03:55:00.655196+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:55:00.655196+0000","last_undegraded":"2023-10-06T03:55:00.655196+0000","last_fullsized":"2023-10-06T03:55:00.655196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016769477000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.14","version":"27'130","reported_seq":143,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:59.597093+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:54:59.597093+0000","last_peered":"2023-10-06T03:54:59.597093+0000","last_clean":"2023-10-06T03:54:59.597093+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:54:59.597093+0000","last_undegraded":"2023-10-06T03:54:59.597093+0000","last_fullsized":"2023-10-06T03:54:59.597093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:56:30.510912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'36","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.540125+0000","last_change":"2023-10-06T03:55:00.540434+0000","last_active":"2023-10-06T03:55:00.540125+0000","last_peered":"2023-10-06T03:55:00.540125+0000","last_clean":"2023-10-06T03:55:00.540125+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:55:00.540125+0000","last_undegraded":"2023-10-06T03:55:00.540125+0000","last_fullsized":"2023-10-06T03:55:00.540125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010103025,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.15","version":"27'14","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:58.712503+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:54:58.712503+0000","last_peered":"2023-10-06T03:54:58.712503+0000","last_clean":"2023-10-06T03:54:58.712503+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:54:58.712503+0000","last_undegraded":"2023-10-06T03:54:58.712503+0000","last_fullsized":"2023-10-06T03:54:58.712503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:51.388453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.703142+0000","last_change":"2023-10-06T03:53:43.655192+0000","last_active":"2023-10-06T03:54:46.703142+0000","last_peered":"2023-10-06T03:54:46.703142+0000","last_clean":"2023-10-06T03:54:46.703142+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:54:46.703142+0000","last_undegraded":"2023-10-06T03:54:46.703142+0000","last_fullsized":"2023-10-06T03:54:46.703142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:12:01.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.782650+0000","last_change":"2023-10-06T03:55:00.783055+0000","last_active":"2023-10-06T03:55:00.782650+0000","last_peered":"2023-10-06T03:55:00.782650+0000","last_clean":"2023-10-06T03:55:00.782650+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:55:00.782650+0000","last_undegraded":"2023-10-06T03:55:00.782650+0000","last_fullsized":"2023-10-06T03:55:00.782650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:47.774023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010254809,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.17","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.687181+0000","last_change":"2023-10-06T03:53:43.655295+0000","last_active":"2023-10-06T03:54:46.687181+0000","last_peered":"2023-10-06T03:54:46.687181+0000","last_clean":"2023-10-06T03:54:46.687181+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:54:46.687181+0000","last_undegraded":"2023-10-06T03:54:46.687181+0000","last_fullsized":"2023-10-06T03:54:46.687181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:55:01.951184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'27","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.783917+0000","last_change":"2023-10-06T03:55:00.784344+0000","last_active":"2023-10-06T03:55:00.783917+0000","last_peered":"2023-10-06T03:55:00.783917+0000","last_clean":"2023-10-06T03:55:00.783917+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:55:00.783917+0000","last_undegraded":"2023-10-06T03:55:00.783917+0000","last_fullsized":"2023-10-06T03:55:00.783917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:52.267730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010824848999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"4.1f","version":"27'29","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.476233+0000","last_change":"2023-10-06T03:55:00.477555+0000","last_active":"2023-10-06T03:55:00.476233+0000","last_peered":"2023-10-06T03:55:00.476233+0000","last_clean":"2023-10-06T03:55:00.476233+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:55:00.476233+0000","last_undegraded":"2023-10-06T03:55:00.476233+0000","last_fullsized":"2023-10-06T03:55:00.476233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:28.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072167000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318313+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:54:26.318313+0000","last_peered":"2023-10-06T03:54:26.318313+0000","last_clean":"2023-10-06T03:54:26.318313+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:54:26.318313+0000","last_undegraded":"2023-10-06T03:54:26.318313+0000","last_fullsized":"2023-10-06T03:54:26.318313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:05:44.933171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'20","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.763935+0000","last_change":"2023-10-06T03:55:00.764287+0000","last_active":"2023-10-06T03:55:00.763935+0000","last_peered":"2023-10-06T03:55:00.763935+0000","last_clean":"2023-10-06T03:55:00.763935+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:55:00.763935+0000","last_undegraded":"2023-10-06T03:55:00.763935+0000","last_fullsized":"2023-10-06T03:55:00.763935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:10:33.778270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096240690000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.19","version":"27'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.704414+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:54:46.704414+0000","last_peered":"2023-10-06T03:54:46.704414+0000","last_clean":"2023-10-06T03:54:46.704414+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:54:46.704414+0000","last_undegraded":"2023-10-06T03:54:46.704414+0000","last_fullsized":"2023-10-06T03:54:46.704414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'52","reported_seq":80,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.782963+0000","last_change":"2023-10-06T03:55:00.783365+0000","last_active":"2023-10-06T03:55:00.782963+0000","last_peered":"2023-10-06T03:55:00.782963+0000","last_clean":"2023-10-06T03:55:00.782963+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:55:00.782963+0000","last_undegraded":"2023-10-06T03:55:00.782963+0000","last_fullsized":"2023-10-06T03:55:00.782963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:48:11.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010425553000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1a","version":"24'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.318147+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:54:26.318147+0000","last_peered":"2023-10-06T03:54:26.318147+0000","last_clean":"2023-10-06T03:54:26.318147+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:54:26.318147+0000","last_undegraded":"2023-10-06T03:54:26.318147+0000","last_fullsized":"2023-10-06T03:54:26.318147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:02:08.631427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'32","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.475557+0000","last_change":"2023-10-06T03:55:00.475985+0000","last_active":"2023-10-06T03:55:00.475557+0000","last_peered":"2023-10-06T03:55:00.475557+0000","last_clean":"2023-10-06T03:55:00.475557+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:55:00.475557+0000","last_undegraded":"2023-10-06T03:55:00.475557+0000","last_fullsized":"2023-10-06T03:55:00.475557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:40.577901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068794099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1b","version":"27'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.700785+0000","last_change":"2023-10-06T03:53:43.656421+0000","last_active":"2023-10-06T03:54:46.700785+0000","last_peered":"2023-10-06T03:54:46.700785+0000","last_clean":"2023-10-06T03:54:46.700785+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:54:46.700785+0000","last_undegraded":"2023-10-06T03:54:46.700785+0000","last_fullsized":"2023-10-06T03:54:46.700785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:22.532500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.655648+0000","last_change":"2023-10-06T03:55:00.656022+0000","last_active":"2023-10-06T03:55:00.655648+0000","last_peered":"2023-10-06T03:55:00.655648+0000","last_clean":"2023-10-06T03:55:00.655648+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:55:00.655648+0000","last_undegraded":"2023-10-06T03:55:00.655648+0000","last_fullsized":"2023-10-06T03:55:00.655648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:05:59.303774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017320401999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1c","version":"24'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:26.322569+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:54:26.322569+0000","last_peered":"2023-10-06T03:54:26.322569+0000","last_clean":"2023-10-06T03:54:26.322569+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:54:26.322569+0000","last_undegraded":"2023-10-06T03:54:26.322569+0000","last_fullsized":"2023-10-06T03:54:26.322569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:17.285118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'34","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.654766+0000","last_change":"2023-10-06T03:55:00.655150+0000","last_active":"2023-10-06T03:55:00.654766+0000","last_peered":"2023-10-06T03:55:00.654766+0000","last_clean":"2023-10-06T03:55:00.654766+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:55:00.654766+0000","last_undegraded":"2023-10-06T03:55:00.654766+0000","last_fullsized":"2023-10-06T03:55:00.654766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:20.198792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1d","version":"27'4","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:56.706824+0000","last_change":"2023-10-06T03:53:43.649541+0000","last_active":"2023-10-06T03:54:56.706824+0000","last_peered":"2023-10-06T03:54:56.706824+0000","last_clean":"2023-10-06T03:54:56.706824+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:54:56.706824+0000","last_undegraded":"2023-10-06T03:54:56.706824+0000","last_fullsized":"2023-10-06T03:54:56.706824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:00.422867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'37","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.782000+0000","last_change":"2023-10-06T03:55:00.782441+0000","last_active":"2023-10-06T03:55:00.782000+0000","last_peered":"2023-10-06T03:55:00.782000+0000","last_clean":"2023-10-06T03:55:00.782000+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:55:00.782000+0000","last_undegraded":"2023-10-06T03:55:00.782000+0000","last_fullsized":"2023-10-06T03:55:00.782000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:19.655715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097448389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1e","version":"27'2","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.706252+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:54:46.706252+0000","last_peered":"2023-10-06T03:54:46.706252+0000","last_clean":"2023-10-06T03:54:46.706252+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:54:46.706252+0000","last_undegraded":"2023-10-06T03:54:46.706252+0000","last_fullsized":"2023-10-06T03:54:46.706252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'33","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T03:55:00.653566+0000","last_change":"2023-10-06T03:55:00.653865+0000","last_active":"2023-10-06T03:55:00.653566+0000","last_peered":"2023-10-06T03:55:00.653566+0000","last_clean":"2023-10-06T03:55:00.653566+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:55:00.653566+0000","last_undegraded":"2023-10-06T03:55:00.653566+0000","last_fullsized":"2023-10-06T03:55:00.653566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:59.419056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016574254,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.1f","version":"27'5","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:54:46.704173+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:54:46.704173+0000","last_peered":"2023-10-06T03:54:46.704173+0000","last_clean":"2023-10-06T03:54:46.704173+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:54:46.704173+0000","last_undegraded":"2023-10-06T03:54:46.704173+0000","last_fullsized":"2023-10-06T03:54:46.704173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:35.309411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":478209,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":202,"num_write_kb":569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":956418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298648,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073192,"statfs":{"total":96636764160,"available":96330948608,"internally_reserved":0,"allocated":1392640,"data_stored":1179202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.2949999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.069}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":2.3849999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.456}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.409},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1950000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.5289999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.96699999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.92400000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.1120000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.0049999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301672,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070168,"statfs":{"total":96636764160,"available":96327852032,"internally_reserved":0,"allocated":294912,"data_stored":110575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":1.0649999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.042}]},{"osd":4,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.2090000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.0920000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":587446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.1899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.125}]},{"osd":3,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.087}]},{"osd":6,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.008}]}]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301668,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070172,"statfs":{"total":96636764160,"available":96327856128,"internally_reserved":0,"allocated":290816,"data_stored":110041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.85599999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.98099999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.085}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.115}]}]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":299008,"data_stored":116734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.82899999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.755}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301664,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070176,"statfs":{"total":96636764160,"available":96327860224,"internally_reserved":0,"allocated":286720,"data_stored":109951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.073}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.024},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.23},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.147}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":1.194},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1120000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":892928,"data_stored":706428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.1599999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.385},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.1899999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":1.353},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.044}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5089999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.4350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":477495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":472100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.223 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.224 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.225 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.226 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.227 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.228 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.229 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:53:33.296006+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=33, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.230 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.231 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T03:53:38.452339+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.232 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.233 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.234 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.235 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:05.236 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:55:25.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:55:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 Processor -- start 2023-10-06T03:55:25.350 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 -- start start 2023-10-06T03:55:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efd1806da70 0x7efd180b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1806c5a0 con 0x7efd180b17a0 2023-10-06T03:55:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1806ce40 con 0x7efd1806da70 2023-10-06T03:55:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd1d2a9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1806edf0 con 0x7efd180701c0 2023-10-06T03:55:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd0ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efd180b17a0 0x7efd180afaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54898/0 (socket says 172.21.15.57:54898) 2023-10-06T03:55:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd0ffff700 1 -- 172.21.15.57:0/4275876145 learned_addr learned my addr 172.21.15.57:0/4275876145 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:25.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4275876145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd177fe700 1 --2- 172.21.15.57:0/4275876145 >> v2:172.21.15.105:3300/0 conn(0x7efd1806da70 0x7efd180b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd167fc700 1 -- 172.21.15.57:0/4275876145 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484399582 0 0) 0x7efd1806c5a0 con 0x7efd180b17a0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd167fc700 1 -- 172.21.15.57:0/4275876145 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd04003570 con 0x7efd180b17a0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd16ffd700 1 -- 172.21.15.57:0/4275876145 >> v2:172.21.15.105:3300/0 conn(0x7efd1806da70 msgr2=0x7efd180b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4275876145 >> v2:172.21.15.105:3300/0 conn(0x7efd1806da70 0x7efd180b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd16ffd700 1 -- 172.21.15.57:0/4275876145 >> v1:172.21.15.57:6789/0 conn(0x7efd180b17a0 legacy=0x7efd180afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.346+0000 7efd16ffd700 1 -- 172.21.15.57:0/4275876145 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1806def0 con 0x7efd180701c0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4275876145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1806d530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd080098e0 tx=0x7efd080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d30e158437186ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd167fc700 1 -- 172.21.15.57:0/4275876145 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08011630 con 0x7efd180701c0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd167fc700 1 -- 172.21.15.57:0/4275876145 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd08011790 con 0x7efd180701c0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd167fc700 1 -- 172.21.15.57:0/4275876145 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08011b10 con 0x7efd180701c0 2023-10-06T03:55:25.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4275876145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 msgr2=0x7efd1806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4275876145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1806d530 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efd080098e0 tx=0x7efd080091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4275876145 shutdown_connections 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4275876145 >> v2:172.21.15.105:3300/0 conn(0x7efd1806da70 0x7efd180b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4275876145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1806d530 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4275876145 >> 172.21.15.57:0/4275876145 conn(0x7efd180b5130 msgr2=0x7efd180b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4275876145 shutdown_connections 2023-10-06T03:55:25.356 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4275876145 wait complete. 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 Processor -- start 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.350+0000 7efd1d2a9700 1 -- start start 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd1806da70 0x7efd1813dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1813c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1813d180 con 0x7efd180b17a0 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd18067580 con 0x7efd1806da70 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd18155620 con 0x7efd180701c0 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.358 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40554/0 (socket says 172.21.15.57:40554) 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 -- 172.21.15.57:0/4170339485 learned_addr learned my addr 172.21.15.57:0/4170339485 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd1806da70 0x7efd1813dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd0ffff700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1813c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 -- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 msgr2=0x7efd1813c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1813c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 -- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd1806da70 msgr2=0x7efd1813dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd1806da70 0x7efd1813dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 -- 172.21.15.57:0/4170339485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08009420 con 0x7efd180b17a0 2023-10-06T03:55:25.359 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd177fe700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd10009ef0 tx=0x7efd1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000cc20 con 0x7efd180b17a0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000f040 con 0x7efd180b17a0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd18067210 con 0x7efd180b17a0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10014480 con 0x7efd180b17a0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd18149ca0 con 0x7efd180b17a0 2023-10-06T03:55:25.360 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.354+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd18067070 con 0x7efd180b17a0 2023-10-06T03:55:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.358+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efd10014830 con 0x7efd180b17a0 2023-10-06T03:55:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.358+0000 7efd0effd700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 0x7efcf8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:25.361 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.358+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efd1007d2f0 con 0x7efd180b17a0 2023-10-06T03:55:25.362 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.358+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 0x7efcf8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:25.363 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.358+0000 7efd16ffd700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 0x7efcf8062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd080091e0 tx=0x7efd08017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:25.370 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.366+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efd18067070 con 0x7efd180b17a0 2023-10-06T03:55:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.518+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd18067070 con 0x7efcf8060550 2023-10-06T03:55:25.542 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.538+0000 7efd0effd700 1 -- 172.21.15.57:0/4170339485 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308572 (secure 0 0 0) 0x7efd18067070 con 0x7efcf8060550 2023-10-06T03:55:25.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:55:25.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 msgr2=0x7efcf8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 0x7efcf8062a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efd080091e0 tx=0x7efd08017000 comp rx=0 tx=0).stop 2023-10-06T03:55:25.549 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 msgr2=0x7efd181550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd10009ef0 tx=0x7efd1000b040 comp rx=0 tx=0).stop 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 shutdown_connections 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efcf8060550 0x7efcf8062a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd180b17a0 0x7efd181550e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd180701c0 0x7efd1813c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 --2- 172.21.15.57:0/4170339485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd1806da70 0x7efd1813dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 >> 172.21.15.57:0/4170339485 conn(0x7efd180b5130 msgr2=0x7efd1813fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 shutdown_connections 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:25.542+0000 7efd1d2a9700 1 -- 172.21.15.57:0/4170339485 wait complete. 2023-10-06T03:55:25.550 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:55:25.561 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-10-06T03:55:24.662454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070280,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":416,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2417,"ondisk_log_size":2417,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403472,"kb_used_data":4688,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571248,"statfs":{"total":773094113280,"available":770632957952,"internally_reserved":0,"allocated":4800512,"data_stored":3176480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004596"},"pg_stats":[{"pgid":"4.3f","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.744705+0000","last_change":"2023-10-06T03:55:12.744584+0000","last_active":"2023-10-06T03:55:12.744705+0000","last_peered":"2023-10-06T03:55:12.744705+0000","last_clean":"2023-10-06T03:55:12.744705+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:55:12.744705+0000","last_undegraded":"2023-10-06T03:55:12.744705+0000","last_fullsized":"2023-10-06T03:55:12.744705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.744297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:23.844802+0000","scrub_duration":0.003817993,"objects_trimmed":0,"snaptrim_duration":0.0072822820000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'18","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241209+0000","last_change":"2023-10-06T03:55:01.283738+0000","last_active":"2023-10-06T03:55:10.241209+0000","last_peered":"2023-10-06T03:55:10.241209+0000","last_clean":"2023-10-06T03:55:10.241209+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:55:10.241209+0000","last_undegraded":"2023-10-06T03:55:10.241209+0000","last_fullsized":"2023-10-06T03:55:10.241209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099787499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181400+0000","last_change":"2023-10-06T03:55:00.655711+0000","last_active":"2023-10-06T03:55:10.181400+0000","last_peered":"2023-10-06T03:55:10.181400+0000","last_clean":"2023-10-06T03:55:10.181400+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:55:10.181400+0000","last_undegraded":"2023-10-06T03:55:10.181400+0000","last_fullsized":"2023-10-06T03:55:10.181400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016761273,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.224501+0000","last_change":"2023-10-06T03:55:00.476090+0000","last_active":"2023-10-06T03:55:10.224501+0000","last_peered":"2023-10-06T03:55:10.224501+0000","last_clean":"2023-10-06T03:55:10.224501+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:55:10.224501+0000","last_undegraded":"2023-10-06T03:55:10.224501+0000","last_fullsized":"2023-10-06T03:55:10.224501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063584109999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'21","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242876+0000","last_change":"2023-10-06T03:55:00.763536+0000","last_active":"2023-10-06T03:55:10.242876+0000","last_peered":"2023-10-06T03:55:10.242876+0000","last_clean":"2023-10-06T03:55:10.242876+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:55:10.242876+0000","last_undegraded":"2023-10-06T03:55:10.242876+0000","last_fullsized":"2023-10-06T03:55:10.242876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010010550999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180101+0000","last_change":"2023-10-06T03:55:00.654853+0000","last_active":"2023-10-06T03:55:10.180101+0000","last_peered":"2023-10-06T03:55:10.180101+0000","last_clean":"2023-10-06T03:55:10.180101+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:55:10.180101+0000","last_undegraded":"2023-10-06T03:55:10.180101+0000","last_fullsized":"2023-10-06T03:55:10.180101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017107009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239448+0000","last_change":"2023-10-06T03:55:00.479572+0000","last_active":"2023-10-06T03:55:10.239448+0000","last_peered":"2023-10-06T03:55:10.239448+0000","last_clean":"2023-10-06T03:55:10.239448+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:55:10.239448+0000","last_undegraded":"2023-10-06T03:55:10.239448+0000","last_fullsized":"2023-10-06T03:55:10.239448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044403079999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240113+0000","last_change":"2023-10-06T03:55:01.283029+0000","last_active":"2023-10-06T03:55:10.240113+0000","last_peered":"2023-10-06T03:55:10.240113+0000","last_clean":"2023-10-06T03:55:10.240113+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:55:10.240113+0000","last_undegraded":"2023-10-06T03:55:10.240113+0000","last_fullsized":"2023-10-06T03:55:10.240113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010671256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243895+0000","last_change":"2023-10-06T03:55:00.763893+0000","last_active":"2023-10-06T03:55:10.243895+0000","last_peered":"2023-10-06T03:55:10.243895+0000","last_clean":"2023-10-06T03:55:10.243895+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:55:10.243895+0000","last_undegraded":"2023-10-06T03:55:10.243895+0000","last_fullsized":"2023-10-06T03:55:10.243895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092769180000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'58","reported_seq":91,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242105+0000","last_change":"2023-10-06T03:55:01.284300+0000","last_active":"2023-10-06T03:55:10.242105+0000","last_peered":"2023-10-06T03:55:10.242105+0000","last_clean":"2023-10-06T03:55:10.242105+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:55:10.242105+0000","last_undegraded":"2023-10-06T03:55:10.242105+0000","last_fullsized":"2023-10-06T03:55:10.242105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010557138000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.581076+0000","last_change":"2023-10-06T03:55:16.580993+0000","last_active":"2023-10-06T03:55:16.581076+0000","last_peered":"2023-10-06T03:55:16.581076+0000","last_clean":"2023-10-06T03:55:16.581076+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:55:16.581076+0000","last_undegraded":"2023-10-06T03:55:16.581076+0000","last_fullsized":"2023-10-06T03:55:16.581076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.580732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:29.697352+0000","scrub_duration":0.0043988070000000002,"objects_trimmed":0,"snaptrim_duration":0.017044597000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:18.844477+0000","last_change":"2023-10-06T03:55:18.844353+0000","last_active":"2023-10-06T03:55:18.844477+0000","last_peered":"2023-10-06T03:55:18.844477+0000","last_clean":"2023-10-06T03:55:18.844477+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:55:18.844477+0000","last_undegraded":"2023-10-06T03:55:18.844477+0000","last_fullsized":"2023-10-06T03:55:18.844477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_clean_scrub_stamp":"2023-10-06T03:55:18.844084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.508568+0000","scrub_duration":0.0043501169999999997,"objects_trimmed":0,"snaptrim_duration":0.0069042510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178061+0000","last_change":"2023-10-06T03:55:05.759217+0000","last_active":"2023-10-06T03:55:10.178061+0000","last_peered":"2023-10-06T03:55:10.178061+0000","last_clean":"2023-10-06T03:55:10.178061+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:55:10.178061+0000","last_undegraded":"2023-10-06T03:55:10.178061+0000","last_fullsized":"2023-10-06T03:55:10.178061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.759109+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.428927+0000","scrub_duration":0.010541894,"objects_trimmed":0,"snaptrim_duration":0.006884589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239865+0000","last_change":"2023-10-06T03:55:01.284272+0000","last_active":"2023-10-06T03:55:10.239865+0000","last_peered":"2023-10-06T03:55:10.239865+0000","last_clean":"2023-10-06T03:55:10.239865+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:55:10.239865+0000","last_undegraded":"2023-10-06T03:55:10.239865+0000","last_fullsized":"2023-10-06T03:55:10.239865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010166412,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240438+0000","last_change":"2023-10-06T03:55:00.479621+0000","last_active":"2023-10-06T03:55:10.240438+0000","last_peered":"2023-10-06T03:55:10.240438+0000","last_clean":"2023-10-06T03:55:10.240438+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:55:10.240438+0000","last_undegraded":"2023-10-06T03:55:10.240438+0000","last_fullsized":"2023-10-06T03:55:10.240438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042743499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178248+0000","last_change":"2023-10-06T03:55:00.653680+0000","last_active":"2023-10-06T03:55:10.178248+0000","last_peered":"2023-10-06T03:55:10.178248+0000","last_clean":"2023-10-06T03:55:10.178248+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:55:10.178248+0000","last_undegraded":"2023-10-06T03:55:10.178248+0000","last_fullsized":"2023-10-06T03:55:10.178248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016525431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'32","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244245+0000","last_change":"2023-10-06T03:55:00.764584+0000","last_active":"2023-10-06T03:55:10.244245+0000","last_peered":"2023-10-06T03:55:10.244245+0000","last_clean":"2023-10-06T03:55:10.244245+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:55:10.244245+0000","last_undegraded":"2023-10-06T03:55:10.244245+0000","last_fullsized":"2023-10-06T03:55:10.244245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096482700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'49","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181517+0000","last_change":"2023-10-06T03:55:00.656823+0000","last_active":"2023-10-06T03:55:10.181517+0000","last_peered":"2023-10-06T03:55:10.181517+0000","last_clean":"2023-10-06T03:55:10.181517+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:55:10.181517+0000","last_undegraded":"2023-10-06T03:55:10.181517+0000","last_fullsized":"2023-10-06T03:55:10.181517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171402999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.756421+0000","last_change":"2023-10-06T03:55:10.756346+0000","last_active":"2023-10-06T03:55:10.756421+0000","last_peered":"2023-10-06T03:55:10.756421+0000","last_clean":"2023-10-06T03:55:10.756421+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:55:10.756421+0000","last_undegraded":"2023-10-06T03:55:10.756421+0000","last_fullsized":"2023-10-06T03:55:10.756421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_clean_scrub_stamp":"2023-10-06T03:55:10.756040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.124413+0000","scrub_duration":0.0040958310000000003,"objects_trimmed":0,"snaptrim_duration":0.0063946960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181212+0000","last_change":"2023-10-06T03:55:00.656042+0000","last_active":"2023-10-06T03:55:10.181212+0000","last_peered":"2023-10-06T03:55:10.181212+0000","last_clean":"2023-10-06T03:55:10.181212+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:55:10.181212+0000","last_undegraded":"2023-10-06T03:55:10.181212+0000","last_fullsized":"2023-10-06T03:55:10.181212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017011842999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240970+0000","last_change":"2023-10-06T03:55:00.480023+0000","last_active":"2023-10-06T03:55:10.240970+0000","last_peered":"2023-10-06T03:55:10.240970+0000","last_clean":"2023-10-06T03:55:10.240970+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:55:10.240970+0000","last_undegraded":"2023-10-06T03:55:10.240970+0000","last_fullsized":"2023-10-06T03:55:10.240970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045883720000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240980+0000","last_change":"2023-10-06T03:55:00.764066+0000","last_active":"2023-10-06T03:55:10.240980+0000","last_peered":"2023-10-06T03:55:10.240980+0000","last_clean":"2023-10-06T03:55:10.240980+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:55:10.240980+0000","last_undegraded":"2023-10-06T03:55:10.240980+0000","last_fullsized":"2023-10-06T03:55:10.240980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010470313,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243810+0000","last_change":"2023-10-06T03:55:00.781344+0000","last_active":"2023-10-06T03:55:10.243810+0000","last_peered":"2023-10-06T03:55:10.243810+0000","last_clean":"2023-10-06T03:55:10.243810+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:55:10.243810+0000","last_undegraded":"2023-10-06T03:55:10.243810+0000","last_fullsized":"2023-10-06T03:55:10.243810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092240970000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239713+0000","last_change":"2023-10-06T03:55:00.479157+0000","last_active":"2023-10-06T03:55:10.239713+0000","last_peered":"2023-10-06T03:55:10.239713+0000","last_clean":"2023-10-06T03:55:10.239713+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:55:10.239713+0000","last_undegraded":"2023-10-06T03:55:10.239713+0000","last_fullsized":"2023-10-06T03:55:10.239713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042144280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241505+0000","last_change":"2023-10-06T03:55:00.540395+0000","last_active":"2023-10-06T03:55:10.241505+0000","last_peered":"2023-10-06T03:55:10.241505+0000","last_clean":"2023-10-06T03:55:10.241505+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:55:10.241505+0000","last_undegraded":"2023-10-06T03:55:10.241505+0000","last_fullsized":"2023-10-06T03:55:10.241505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010852538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'53","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240590+0000","last_change":"2023-10-06T03:55:00.539935+0000","last_active":"2023-10-06T03:55:10.240590+0000","last_peered":"2023-10-06T03:55:10.240590+0000","last_clean":"2023-10-06T03:55:10.240590+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:55:10.240590+0000","last_undegraded":"2023-10-06T03:55:10.240590+0000","last_fullsized":"2023-10-06T03:55:10.240590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096577650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241317+0000","last_change":"2023-10-06T03:55:01.283520+0000","last_active":"2023-10-06T03:55:10.241317+0000","last_peered":"2023-10-06T03:55:10.241317+0000","last_clean":"2023-10-06T03:55:10.241317+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:55:10.241317+0000","last_undegraded":"2023-10-06T03:55:10.241317+0000","last_fullsized":"2023-10-06T03:55:10.241317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097876560000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'19","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241552+0000","last_change":"2023-10-06T03:55:00.541029+0000","last_active":"2023-10-06T03:55:10.241552+0000","last_peered":"2023-10-06T03:55:10.241552+0000","last_clean":"2023-10-06T03:55:10.241552+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:55:10.241552+0000","last_undegraded":"2023-10-06T03:55:10.241552+0000","last_fullsized":"2023-10-06T03:55:10.241552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010385257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.245689+0000","last_change":"2023-10-06T03:55:00.784773+0000","last_active":"2023-10-06T03:55:10.245689+0000","last_peered":"2023-10-06T03:55:10.245689+0000","last_clean":"2023-10-06T03:55:10.245689+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:55:10.245689+0000","last_undegraded":"2023-10-06T03:55:10.245689+0000","last_fullsized":"2023-10-06T03:55:10.245689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091510959999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180518+0000","last_change":"2023-10-06T03:55:04.638303+0000","last_active":"2023-10-06T03:55:10.180518+0000","last_peered":"2023-10-06T03:55:10.180518+0000","last_clean":"2023-10-06T03:55:10.180518+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:55:10.180518+0000","last_undegraded":"2023-10-06T03:55:10.180518+0000","last_fullsized":"2023-10-06T03:55:10.180518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.638053+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:02.084340+0000","scrub_duration":0.0042471119999999999,"objects_trimmed":0,"snaptrim_duration":0.017042165000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244404+0000","last_change":"2023-10-06T03:55:00.782891+0000","last_active":"2023-10-06T03:55:10.244404+0000","last_peered":"2023-10-06T03:55:10.244404+0000","last_clean":"2023-10-06T03:55:10.244404+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:55:10.244404+0000","last_undegraded":"2023-10-06T03:55:10.244404+0000","last_fullsized":"2023-10-06T03:55:10.244404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010478619,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.223916+0000","last_change":"2023-10-06T03:55:00.476360+0000","last_active":"2023-10-06T03:55:10.223916+0000","last_peered":"2023-10-06T03:55:10.223916+0000","last_clean":"2023-10-06T03:55:10.223916+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:55:10.223916+0000","last_undegraded":"2023-10-06T03:55:10.223916+0000","last_fullsized":"2023-10-06T03:55:10.223916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007180461,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.248047+0000","last_change":"2023-10-06T03:55:00.783861+0000","last_active":"2023-10-06T03:55:10.248047+0000","last_peered":"2023-10-06T03:55:10.248047+0000","last_clean":"2023-10-06T03:55:10.248047+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:55:10.248047+0000","last_undegraded":"2023-10-06T03:55:10.248047+0000","last_fullsized":"2023-10-06T03:55:10.248047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010865144,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.612812+0000","last_change":"2023-10-06T03:53:43.658730+0000","last_active":"2023-10-06T03:55:05.612812+0000","last_peered":"2023-10-06T03:55:05.612812+0000","last_clean":"2023-10-06T03:55:05.612812+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:55:05.612812+0000","last_undegraded":"2023-10-06T03:55:05.612812+0000","last_fullsized":"2023-10-06T03:55:05.612812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'30","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241486+0000","last_change":"2023-10-06T03:55:01.283914+0000","last_active":"2023-10-06T03:55:10.241486+0000","last_peered":"2023-10-06T03:55:10.241486+0000","last_clean":"2023-10-06T03:55:10.241486+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:55:10.241486+0000","last_undegraded":"2023-10-06T03:55:10.241486+0000","last_fullsized":"2023-10-06T03:55:10.241486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097426309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.509563+0000","last_change":"2023-10-06T03:55:12.509433+0000","last_active":"2023-10-06T03:55:12.509563+0000","last_peered":"2023-10-06T03:55:12.509563+0000","last_clean":"2023-10-06T03:55:12.509563+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:55:12.509563+0000","last_undegraded":"2023-10-06T03:55:12.509563+0000","last_fullsized":"2023-10-06T03:55:12.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.509162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:45.173964+0000","scrub_duration":0.004617454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'37","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244918+0000","last_change":"2023-10-06T03:55:00.765130+0000","last_active":"2023-10-06T03:55:10.244918+0000","last_peered":"2023-10-06T03:55:10.244918+0000","last_clean":"2023-10-06T03:55:10.244918+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:55:10.244918+0000","last_undegraded":"2023-10-06T03:55:10.244918+0000","last_fullsized":"2023-10-06T03:55:10.244918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097705469999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.612194+0000","last_change":"2023-10-06T03:55:19.612128+0000","last_active":"2023-10-06T03:55:19.612194+0000","last_peered":"2023-10-06T03:55:19.612194+0000","last_clean":"2023-10-06T03:55:19.612194+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:55:19.612194+0000","last_undegraded":"2023-10-06T03:55:19.612194+0000","last_fullsized":"2023-10-06T03:55:19.612194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.611867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:23.143979+0000","scrub_duration":0.0039385999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.246865+0000","last_change":"2023-10-06T03:55:00.784450+0000","last_active":"2023-10-06T03:55:10.246865+0000","last_peered":"2023-10-06T03:55:10.246865+0000","last_clean":"2023-10-06T03:55:10.246865+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:55:10.246865+0000","last_undegraded":"2023-10-06T03:55:10.246865+0000","last_fullsized":"2023-10-06T03:55:10.246865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01003823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"30'13","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:11.262927+0000","last_change":"2023-10-06T03:55:11.262836+0000","last_active":"2023-10-06T03:55:11.262927+0000","last_peered":"2023-10-06T03:55:11.262927+0000","last_clean":"2023-10-06T03:55:11.262927+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:55:11.262927+0000","last_undegraded":"2023-10-06T03:55:11.262927+0000","last_fullsized":"2023-10-06T03:55:11.262927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_clean_scrub_stamp":"2023-10-06T03:55:11.262564+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.630938+0000","scrub_duration":0.010133995999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.613735+0000","last_change":"2023-10-06T03:53:43.656379+0000","last_active":"2023-10-06T03:55:05.613735+0000","last_peered":"2023-10-06T03:55:05.613735+0000","last_clean":"2023-10-06T03:55:05.613735+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:55:05.613735+0000","last_undegraded":"2023-10-06T03:55:05.613735+0000","last_fullsized":"2023-10-06T03:55:05.613735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239358+0000","last_change":"2023-10-06T03:55:01.284674+0000","last_active":"2023-10-06T03:55:10.239358+0000","last_peered":"2023-10-06T03:55:10.239358+0000","last_clean":"2023-10-06T03:55:10.239358+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:55:10.239358+0000","last_undegraded":"2023-10-06T03:55:10.239358+0000","last_fullsized":"2023-10-06T03:55:10.239358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010236192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.613612+0000","last_change":"2023-10-06T03:53:43.657624+0000","last_active":"2023-10-06T03:55:05.613612+0000","last_peered":"2023-10-06T03:55:05.613612+0000","last_clean":"2023-10-06T03:55:05.613612+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:55:05.613612+0000","last_undegraded":"2023-10-06T03:55:05.613612+0000","last_fullsized":"2023-10-06T03:55:05.613612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'10","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178359+0000","last_change":"2023-10-06T03:55:00.654289+0000","last_active":"2023-10-06T03:55:10.178359+0000","last_peered":"2023-10-06T03:55:10.178359+0000","last_clean":"2023-10-06T03:55:10.178359+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:55:10.178359+0000","last_undegraded":"2023-10-06T03:55:10.178359+0000","last_fullsized":"2023-10-06T03:55:10.178359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016897651999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.613394+0000","last_change":"2023-10-06T03:53:43.656367+0000","last_active":"2023-10-06T03:55:05.613394+0000","last_peered":"2023-10-06T03:55:05.613394+0000","last_clean":"2023-10-06T03:55:05.613394+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:55:05.613394+0000","last_undegraded":"2023-10-06T03:55:05.613394+0000","last_fullsized":"2023-10-06T03:55:05.613394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'24","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.224184+0000","last_change":"2023-10-06T03:55:00.475712+0000","last_active":"2023-10-06T03:55:10.224184+0000","last_peered":"2023-10-06T03:55:10.224184+0000","last_clean":"2023-10-06T03:55:10.224184+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:55:10.224184+0000","last_undegraded":"2023-10-06T03:55:10.224184+0000","last_fullsized":"2023-10-06T03:55:10.224184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063459989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.380585+0000","last_change":"2023-10-06T03:55:06.380488+0000","last_active":"2023-10-06T03:55:06.380585+0000","last_peered":"2023-10-06T03:55:06.380585+0000","last_clean":"2023-10-06T03:55:06.380585+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:55:06.380585+0000","last_undegraded":"2023-10-06T03:55:06.380585+0000","last_fullsized":"2023-10-06T03:55:06.380585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.380239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:10.084652+0000","scrub_duration":0.0039703960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242236+0000","last_change":"2023-10-06T03:55:00.762223+0000","last_active":"2023-10-06T03:55:10.242236+0000","last_peered":"2023-10-06T03:55:10.242236+0000","last_clean":"2023-10-06T03:55:10.242236+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:55:10.242236+0000","last_undegraded":"2023-10-06T03:55:10.242236+0000","last_fullsized":"2023-10-06T03:55:10.242236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091432119999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.703876+0000","last_change":"2023-10-06T03:55:16.703748+0000","last_active":"2023-10-06T03:55:16.703876+0000","last_peered":"2023-10-06T03:55:16.703876+0000","last_clean":"2023-10-06T03:55:16.703876+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:55:16.703876+0000","last_undegraded":"2023-10-06T03:55:16.703876+0000","last_fullsized":"2023-10-06T03:55:16.703876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.703443+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:49.368245+0000","scrub_duration":0.011084629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181626+0000","last_change":"2023-10-06T03:55:00.656394+0000","last_active":"2023-10-06T03:55:10.181626+0000","last_peered":"2023-10-06T03:55:10.181626+0000","last_clean":"2023-10-06T03:55:10.181626+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:55:10.181626+0000","last_undegraded":"2023-10-06T03:55:10.181626+0000","last_fullsized":"2023-10-06T03:55:10.181626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017145036999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.301487+0000","last_change":"2023-10-06T03:55:13.301391+0000","last_active":"2023-10-06T03:55:13.301487+0000","last_peered":"2023-10-06T03:55:13.301487+0000","last_clean":"2023-10-06T03:55:13.301487+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:55:13.301487+0000","last_undegraded":"2023-10-06T03:55:13.301487+0000","last_fullsized":"2023-10-06T03:55:13.301487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.301122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:24.401627+0000","scrub_duration":0.0044995039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181819+0000","last_change":"2023-10-06T03:55:00.656528+0000","last_active":"2023-10-06T03:55:10.181819+0000","last_peered":"2023-10-06T03:55:10.181819+0000","last_clean":"2023-10-06T03:55:10.181819+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:55:10.181819+0000","last_undegraded":"2023-10-06T03:55:10.181819+0000","last_fullsized":"2023-10-06T03:55:10.181819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017135524999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.634668+0000","last_change":"2023-10-06T03:55:20.634606+0000","last_active":"2023-10-06T03:55:20.634668+0000","last_peered":"2023-10-06T03:55:20.634668+0000","last_clean":"2023-10-06T03:55:20.634668+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:55:20.634668+0000","last_undegraded":"2023-10-06T03:55:20.634668+0000","last_fullsized":"2023-10-06T03:55:20.634668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.634345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:11.013941+0000","scrub_duration":0.0041101649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181433+0000","last_change":"2023-10-06T03:55:00.657069+0000","last_active":"2023-10-06T03:55:10.181433+0000","last_peered":"2023-10-06T03:55:10.181433+0000","last_clean":"2023-10-06T03:55:10.181433+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:55:10.181433+0000","last_undegraded":"2023-10-06T03:55:10.181433+0000","last_fullsized":"2023-10-06T03:55:10.181433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017297254000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:08.771338+0000","last_change":"2023-10-06T03:55:08.771121+0000","last_active":"2023-10-06T03:55:08.771338+0000","last_peered":"2023-10-06T03:55:08.771338+0000","last_clean":"2023-10-06T03:55:08.771338+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:55:08.771338+0000","last_undegraded":"2023-10-06T03:55:08.771338+0000","last_fullsized":"2023-10-06T03:55:08.771338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_clean_scrub_stamp":"2023-10-06T03:55:08.770817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:34.435300+0000","scrub_duration":0.0040354609999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242005+0000","last_change":"2023-10-06T03:55:00.539918+0000","last_active":"2023-10-06T03:55:10.242005+0000","last_peered":"2023-10-06T03:55:10.242005+0000","last_clean":"2023-10-06T03:55:10.242005+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:55:10.242005+0000","last_undegraded":"2023-10-06T03:55:10.242005+0000","last_fullsized":"2023-10-06T03:55:10.242005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099655790000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.640255+0000","last_change":"2023-10-06T03:55:07.640070+0000","last_active":"2023-10-06T03:55:07.640255+0000","last_peered":"2023-10-06T03:55:07.640255+0000","last_clean":"2023-10-06T03:55:07.640255+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:55:07.640255+0000","last_undegraded":"2023-10-06T03:55:07.640255+0000","last_fullsized":"2023-10-06T03:55:07.640255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.639807+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.740312+0000","scrub_duration":0.013574480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.382170+0000","last_change":"2023-10-06T03:55:05.381563+0000","last_active":"2023-10-06T03:55:05.382170+0000","last_peered":"2023-10-06T03:55:05.382170+0000","last_clean":"2023-10-06T03:55:05.382170+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:55:05.382170+0000","last_undegraded":"2023-10-06T03:55:05.382170+0000","last_fullsized":"2023-10-06T03:55:05.382170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.381223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:37.257218+0000","scrub_duration":0.0045535489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.753494+0000","last_change":"2023-10-06T03:53:43.661903+0000","last_active":"2023-10-06T03:55:05.753494+0000","last_peered":"2023-10-06T03:55:05.753494+0000","last_clean":"2023-10-06T03:55:05.753494+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:55:05.753494+0000","last_undegraded":"2023-10-06T03:55:05.753494+0000","last_fullsized":"2023-10-06T03:55:05.753494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.267114+0000","last_change":"2023-10-06T03:55:19.266995+0000","last_active":"2023-10-06T03:55:19.267114+0000","last_peered":"2023-10-06T03:55:19.267114+0000","last_clean":"2023-10-06T03:55:19.267114+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:55:19.267114+0000","last_undegraded":"2023-10-06T03:55:19.267114+0000","last_fullsized":"2023-10-06T03:55:19.267114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.266595+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.931079+0000","scrub_duration":0.004022856,"objects_trimmed":0,"snaptrim_duration":0.006907687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.633309+0000","last_change":"2023-10-06T03:55:12.633170+0000","last_active":"2023-10-06T03:55:12.633309+0000","last_peered":"2023-10-06T03:55:12.633309+0000","last_clean":"2023-10-06T03:55:12.633309+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:55:12.633309+0000","last_undegraded":"2023-10-06T03:55:12.633309+0000","last_fullsized":"2023-10-06T03:55:12.633309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.632897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:38.297380+0000","scrub_duration":0.005677596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.486436+0000","last_change":"2023-10-06T03:55:19.486358+0000","last_active":"2023-10-06T03:55:19.486436+0000","last_peered":"2023-10-06T03:55:19.486436+0000","last_clean":"2023-10-06T03:55:19.486436+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:55:19.486436+0000","last_undegraded":"2023-10-06T03:55:19.486436+0000","last_fullsized":"2023-10-06T03:55:19.486436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.486077+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:32.602697+0000","scrub_duration":0.0050046780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244190+0000","last_change":"2023-10-06T03:55:00.764686+0000","last_active":"2023-10-06T03:55:10.244190+0000","last_peered":"2023-10-06T03:55:10.244190+0000","last_clean":"2023-10-06T03:55:10.244190+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:55:10.244190+0000","last_undegraded":"2023-10-06T03:55:10.244190+0000","last_fullsized":"2023-10-06T03:55:10.244190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0095532519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.388616+0000","last_change":"2023-10-06T03:55:03.796402+0000","last_active":"2023-10-06T03:55:05.388616+0000","last_peered":"2023-10-06T03:55:05.388616+0000","last_clean":"2023-10-06T03:55:05.388616+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:55:05.388616+0000","last_undegraded":"2023-10-06T03:55:05.388616+0000","last_fullsized":"2023-10-06T03:55:05.388616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_clean_scrub_stamp":"2023-10-06T03:55:03.796132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:06.103535+0000","scrub_duration":0.0035169239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.496877+0000","last_change":"2023-10-06T03:55:13.496803+0000","last_active":"2023-10-06T03:55:13.496877+0000","last_peered":"2023-10-06T03:55:13.496877+0000","last_clean":"2023-10-06T03:55:13.496877+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:55:13.496877+0000","last_undegraded":"2023-10-06T03:55:13.496877+0000","last_fullsized":"2023-10-06T03:55:13.496877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.496501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:39.160985+0000","scrub_duration":0.0059863599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'28","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242497+0000","last_change":"2023-10-06T03:55:00.540927+0000","last_active":"2023-10-06T03:55:10.242497+0000","last_peered":"2023-10-06T03:55:10.242497+0000","last_clean":"2023-10-06T03:55:10.242497+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:55:10.242497+0000","last_undegraded":"2023-10-06T03:55:10.242497+0000","last_fullsized":"2023-10-06T03:55:10.242497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010907283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.381440+0000","last_change":"2023-10-06T03:55:04.330738+0000","last_active":"2023-10-06T03:55:05.381440+0000","last_peered":"2023-10-06T03:55:05.381440+0000","last_clean":"2023-10-06T03:55:05.381440+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:55:05.381440+0000","last_undegraded":"2023-10-06T03:55:05.381440+0000","last_fullsized":"2023-10-06T03:55:05.381440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.330335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.964328+0000","scrub_duration":0.004180291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.178546+0000","last_change":"2023-10-06T03:53:43.660560+0000","last_active":"2023-10-06T03:55:05.178546+0000","last_peered":"2023-10-06T03:55:05.178546+0000","last_clean":"2023-10-06T03:55:05.178546+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:55:05.178546+0000","last_undegraded":"2023-10-06T03:55:05.178546+0000","last_fullsized":"2023-10-06T03:55:05.178546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'35","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239480+0000","last_change":"2023-10-06T03:55:01.283044+0000","last_active":"2023-10-06T03:55:10.239480+0000","last_peered":"2023-10-06T03:55:10.239480+0000","last_clean":"2023-10-06T03:55:10.239480+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:55:10.239480+0000","last_undegraded":"2023-10-06T03:55:10.239480+0000","last_fullsized":"2023-10-06T03:55:10.239480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010188835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.293117+0000","last_change":"2023-10-06T03:55:12.293033+0000","last_active":"2023-10-06T03:55:12.293117+0000","last_peered":"2023-10-06T03:55:12.293117+0000","last_clean":"2023-10-06T03:55:12.293117+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:55:12.293117+0000","last_undegraded":"2023-10-06T03:55:12.293117+0000","last_fullsized":"2023-10-06T03:55:12.293117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.292753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:14.664468+0000","scrub_duration":0.004434566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.520693+0000","last_change":"2023-10-06T03:55:07.520556+0000","last_active":"2023-10-06T03:55:07.520693+0000","last_peered":"2023-10-06T03:55:07.520693+0000","last_clean":"2023-10-06T03:55:07.520693+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:55:07.520693+0000","last_undegraded":"2023-10-06T03:55:07.520693+0000","last_fullsized":"2023-10-06T03:55:07.520693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.520348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.620853+0000","scrub_duration":0.003511218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.246326+0000","last_change":"2023-10-06T03:55:00.541459+0000","last_active":"2023-10-06T03:55:10.246326+0000","last_peered":"2023-10-06T03:55:10.246326+0000","last_clean":"2023-10-06T03:55:10.246326+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:55:10.246326+0000","last_undegraded":"2023-10-06T03:55:10.246326+0000","last_fullsized":"2023-10-06T03:55:10.246326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010698005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.458936+0000","last_change":"2023-10-06T03:55:16.458859+0000","last_active":"2023-10-06T03:55:16.458936+0000","last_peered":"2023-10-06T03:55:16.458936+0000","last_clean":"2023-10-06T03:55:16.458936+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:55:16.458936+0000","last_undegraded":"2023-10-06T03:55:16.458936+0000","last_fullsized":"2023-10-06T03:55:16.458936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.458563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:13.904851+0000","scrub_duration":0.0042922999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.633759+0000","last_change":"2023-10-06T03:55:13.633679+0000","last_active":"2023-10-06T03:55:13.633759+0000","last_peered":"2023-10-06T03:55:13.633759+0000","last_clean":"2023-10-06T03:55:13.633759+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:55:13.633759+0000","last_undegraded":"2023-10-06T03:55:13.633759+0000","last_fullsized":"2023-10-06T03:55:13.633759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.633435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:11.079723+0000","scrub_duration":0.004040732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242290+0000","last_change":"2023-10-06T03:55:00.762424+0000","last_active":"2023-10-06T03:55:10.242290+0000","last_peered":"2023-10-06T03:55:10.242290+0000","last_clean":"2023-10-06T03:55:10.242290+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:55:10.242290+0000","last_undegraded":"2023-10-06T03:55:10.242290+0000","last_fullsized":"2023-10-06T03:55:10.242290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093781690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.756282+0000","last_change":"2023-10-06T03:53:43.655956+0000","last_active":"2023-10-06T03:55:05.756282+0000","last_peered":"2023-10-06T03:55:05.756282+0000","last_clean":"2023-10-06T03:55:05.756282+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:55:05.756282+0000","last_undegraded":"2023-10-06T03:55:05.756282+0000","last_fullsized":"2023-10-06T03:55:05.756282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.506143+0000","last_change":"2023-10-06T03:55:05.502487+0000","last_active":"2023-10-06T03:55:05.506143+0000","last_peered":"2023-10-06T03:55:05.506143+0000","last_clean":"2023-10-06T03:55:05.506143+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:55:05.506143+0000","last_undegraded":"2023-10-06T03:55:05.506143+0000","last_fullsized":"2023-10-06T03:55:05.506143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.502231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:32.870605+0000","scrub_duration":0.0037392129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241283+0000","last_change":"2023-10-06T03:55:00.783968+0000","last_active":"2023-10-06T03:55:10.241283+0000","last_peered":"2023-10-06T03:55:10.241283+0000","last_clean":"2023-10-06T03:55:10.241283+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:55:10.241283+0000","last_undegraded":"2023-10-06T03:55:10.241283+0000","last_fullsized":"2023-10-06T03:55:10.241283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010244603,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'6","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.456074+0000","last_change":"2023-10-06T03:55:06.455929+0000","last_active":"2023-10-06T03:55:06.456074+0000","last_peered":"2023-10-06T03:55:06.456074+0000","last_clean":"2023-10-06T03:55:06.456074+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:55:06.456074+0000","last_undegraded":"2023-10-06T03:55:06.456074+0000","last_fullsized":"2023-10-06T03:55:06.456074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.455659+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:32.120143+0000","scrub_duration":0.0048712210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.162781+0000","last_change":"2023-10-06T03:55:06.162696+0000","last_active":"2023-10-06T03:55:06.162781+0000","last_peered":"2023-10-06T03:55:06.162781+0000","last_clean":"2023-10-06T03:55:06.162781+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:55:06.162781+0000","last_undegraded":"2023-10-06T03:55:06.162781+0000","last_fullsized":"2023-10-06T03:55:06.162781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.162407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.832225+0000","scrub_duration":0.0036688609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179756+0000","last_change":"2023-10-06T03:55:09.636062+0000","last_active":"2023-10-06T03:55:10.179756+0000","last_peered":"2023-10-06T03:55:10.179756+0000","last_clean":"2023-10-06T03:55:10.179756+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:55:10.179756+0000","last_undegraded":"2023-10-06T03:55:10.179756+0000","last_fullsized":"2023-10-06T03:55:10.179756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_clean_scrub_stamp":"2023-10-06T03:55:09.635780+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:42.300582+0000","scrub_duration":0.0040873719999999997,"objects_trimmed":0,"snaptrim_duration":0.017171291000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'61","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:17.596116+0000","last_change":"2023-10-06T03:55:17.596047+0000","last_active":"2023-10-06T03:55:17.596116+0000","last_peered":"2023-10-06T03:55:17.596116+0000","last_clean":"2023-10-06T03:55:17.596116+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:55:17.596116+0000","last_undegraded":"2023-10-06T03:55:17.596116+0000","last_fullsized":"2023-10-06T03:55:17.596116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_clean_scrub_stamp":"2023-10-06T03:55:17.595793+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:24.513035+0000","scrub_duration":0.0039416820000000002,"objects_trimmed":0,"snaptrim_duration":0.016769477000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"28'133","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.178452+0000","last_change":"2023-10-06T03:53:43.656697+0000","last_active":"2023-10-06T03:55:05.178452+0000","last_peered":"2023-10-06T03:55:05.178452+0000","last_clean":"2023-10-06T03:55:05.178452+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:55:05.178452+0000","last_undegraded":"2023-10-06T03:55:05.178452+0000","last_fullsized":"2023-10-06T03:55:05.178452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473587,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.245774+0000","last_change":"2023-10-06T03:55:00.540434+0000","last_active":"2023-10-06T03:55:10.245774+0000","last_peered":"2023-10-06T03:55:10.245774+0000","last_clean":"2023-10-06T03:55:10.245774+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:55:10.245774+0000","last_undegraded":"2023-10-06T03:55:10.245774+0000","last_fullsized":"2023-10-06T03:55:10.245774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010103025,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"27'14","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.613352+0000","last_change":"2023-10-06T03:53:43.669024+0000","last_active":"2023-10-06T03:55:05.613352+0000","last_peered":"2023-10-06T03:55:05.613352+0000","last_clean":"2023-10-06T03:55:05.613352+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:55:05.613352+0000","last_undegraded":"2023-10-06T03:55:05.613352+0000","last_fullsized":"2023-10-06T03:55:05.613352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.345078+0000","last_change":"2023-10-06T03:55:07.344971+0000","last_active":"2023-10-06T03:55:07.345078+0000","last_peered":"2023-10-06T03:55:07.345078+0000","last_clean":"2023-10-06T03:55:07.345078+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:55:07.345078+0000","last_undegraded":"2023-10-06T03:55:07.345078+0000","last_fullsized":"2023-10-06T03:55:07.345078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.344686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:31.239949+0000","scrub_duration":0.004290271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.246798+0000","last_change":"2023-10-06T03:55:00.783055+0000","last_active":"2023-10-06T03:55:10.246798+0000","last_peered":"2023-10-06T03:55:10.246798+0000","last_clean":"2023-10-06T03:55:10.246798+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:55:10.246798+0000","last_undegraded":"2023-10-06T03:55:10.246798+0000","last_fullsized":"2023-10-06T03:55:10.246798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010254809,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.461561+0000","last_change":"2023-10-06T03:55:20.461433+0000","last_active":"2023-10-06T03:55:20.461561+0000","last_peered":"2023-10-06T03:55:20.461561+0000","last_clean":"2023-10-06T03:55:20.461561+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:55:20.461561+0000","last_undegraded":"2023-10-06T03:55:20.461561+0000","last_fullsized":"2023-10-06T03:55:20.461561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.461129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:27.378371+0000","scrub_duration":0.0050521910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241276+0000","last_change":"2023-10-06T03:55:00.784344+0000","last_active":"2023-10-06T03:55:10.241276+0000","last_peered":"2023-10-06T03:55:10.241276+0000","last_clean":"2023-10-06T03:55:10.241276+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:55:10.241276+0000","last_undegraded":"2023-10-06T03:55:10.241276+0000","last_fullsized":"2023-10-06T03:55:10.241276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010824848999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.223683+0000","last_change":"2023-10-06T03:55:00.477555+0000","last_active":"2023-10-06T03:55:10.223683+0000","last_peered":"2023-10-06T03:55:10.223683+0000","last_clean":"2023-10-06T03:55:10.223683+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:55:10.223683+0000","last_undegraded":"2023-10-06T03:55:10.223683+0000","last_fullsized":"2023-10-06T03:55:10.223683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0072167000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.754505+0000","last_change":"2023-10-06T03:53:43.666958+0000","last_active":"2023-10-06T03:55:05.754505+0000","last_peered":"2023-10-06T03:55:05.754505+0000","last_clean":"2023-10-06T03:55:05.754505+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:55:05.754505+0000","last_undegraded":"2023-10-06T03:55:05.754505+0000","last_fullsized":"2023-10-06T03:55:05.754505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244094+0000","last_change":"2023-10-06T03:55:00.764287+0000","last_active":"2023-10-06T03:55:10.244094+0000","last_peered":"2023-10-06T03:55:10.244094+0000","last_clean":"2023-10-06T03:55:10.244094+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:55:10.244094+0000","last_undegraded":"2023-10-06T03:55:10.244094+0000","last_fullsized":"2023-10-06T03:55:10.244094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096240690000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.504567+0000","last_change":"2023-10-06T03:53:43.668851+0000","last_active":"2023-10-06T03:55:05.504567+0000","last_peered":"2023-10-06T03:55:05.504567+0000","last_clean":"2023-10-06T03:55:05.504567+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:55:05.504567+0000","last_undegraded":"2023-10-06T03:55:05.504567+0000","last_fullsized":"2023-10-06T03:55:05.504567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'52","reported_seq":85,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243466+0000","last_change":"2023-10-06T03:55:00.783365+0000","last_active":"2023-10-06T03:55:10.243466+0000","last_peered":"2023-10-06T03:55:10.243466+0000","last_clean":"2023-10-06T03:55:10.243466+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:55:10.243466+0000","last_undegraded":"2023-10-06T03:55:10.243466+0000","last_fullsized":"2023-10-06T03:55:10.243466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010425553000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.178495+0000","last_change":"2023-10-06T03:53:43.656319+0000","last_active":"2023-10-06T03:55:05.178495+0000","last_peered":"2023-10-06T03:55:05.178495+0000","last_clean":"2023-10-06T03:55:05.178495+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:55:05.178495+0000","last_undegraded":"2023-10-06T03:55:05.178495+0000","last_fullsized":"2023-10-06T03:55:05.178495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179026+0000","last_change":"2023-10-06T03:55:04.752729+0000","last_active":"2023-10-06T03:55:10.179026+0000","last_peered":"2023-10-06T03:55:10.179026+0000","last_clean":"2023-10-06T03:55:10.179026+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:55:10.179026+0000","last_undegraded":"2023-10-06T03:55:10.179026+0000","last_fullsized":"2023-10-06T03:55:10.179026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.752482+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.597358+0000","scrub_duration":0.0040964770000000003,"objects_trimmed":0,"snaptrim_duration":0.0068794099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.470473+0000","last_change":"2023-10-06T03:55:07.470370+0000","last_active":"2023-10-06T03:55:07.470473+0000","last_peered":"2023-10-06T03:55:07.470473+0000","last_clean":"2023-10-06T03:55:07.470473+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:55:07.470473+0000","last_undegraded":"2023-10-06T03:55:07.470473+0000","last_fullsized":"2023-10-06T03:55:07.470473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.470104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:04.916392+0000","scrub_duration":0.0045462330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181021+0000","last_change":"2023-10-06T03:55:00.656022+0000","last_active":"2023-10-06T03:55:10.181021+0000","last_peered":"2023-10-06T03:55:10.181021+0000","last_clean":"2023-10-06T03:55:10.181021+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:55:10.181021+0000","last_undegraded":"2023-10-06T03:55:10.181021+0000","last_fullsized":"2023-10-06T03:55:10.181021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017320401999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.382131+0000","last_change":"2023-10-06T03:53:43.651182+0000","last_active":"2023-10-06T03:55:05.382131+0000","last_peered":"2023-10-06T03:55:05.382131+0000","last_clean":"2023-10-06T03:55:05.382131+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:55:05.382131+0000","last_undegraded":"2023-10-06T03:55:05.382131+0000","last_fullsized":"2023-10-06T03:55:05.382131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180143+0000","last_change":"2023-10-06T03:55:00.655150+0000","last_active":"2023-10-06T03:55:10.180143+0000","last_peered":"2023-10-06T03:55:10.180143+0000","last_clean":"2023-10-06T03:55:10.180143+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:55:10.180143+0000","last_undegraded":"2023-10-06T03:55:10.180143+0000","last_fullsized":"2023-10-06T03:55:10.180143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:14.354640+0000","last_change":"2023-10-06T03:55:14.354561+0000","last_active":"2023-10-06T03:55:14.354640+0000","last_peered":"2023-10-06T03:55:14.354640+0000","last_clean":"2023-10-06T03:55:14.354640+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:55:14.354640+0000","last_undegraded":"2023-10-06T03:55:14.354640+0000","last_fullsized":"2023-10-06T03:55:14.354640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_clean_scrub_stamp":"2023-10-06T03:55:14.354279+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:59.917325+0000","scrub_duration":0.0068327010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'37","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.247357+0000","last_change":"2023-10-06T03:55:00.782441+0000","last_active":"2023-10-06T03:55:10.247357+0000","last_peered":"2023-10-06T03:55:10.247357+0000","last_clean":"2023-10-06T03:55:10.247357+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:55:10.247357+0000","last_undegraded":"2023-10-06T03:55:10.247357+0000","last_fullsized":"2023-10-06T03:55:10.247357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097448389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.753214+0000","last_change":"2023-10-06T03:53:43.650029+0000","last_active":"2023-10-06T03:55:05.753214+0000","last_peered":"2023-10-06T03:55:05.753214+0000","last_clean":"2023-10-06T03:55:05.753214+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:55:05.753214+0000","last_undegraded":"2023-10-06T03:55:05.753214+0000","last_fullsized":"2023-10-06T03:55:05.753214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178331+0000","last_change":"2023-10-06T03:55:00.653865+0000","last_active":"2023-10-06T03:55:10.178331+0000","last_peered":"2023-10-06T03:55:10.178331+0000","last_clean":"2023-10-06T03:55:10.178331+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:55:10.178331+0000","last_undegraded":"2023-10-06T03:55:10.178331+0000","last_fullsized":"2023-10-06T03:55:10.178331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016574254,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"27'5","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.178523+0000","last_change":"2023-10-06T03:53:43.655712+0000","last_active":"2023-10-06T03:55:05.178523+0000","last_peered":"2023-10-06T03:55:05.178523+0000","last_clean":"2023-10-06T03:55:05.178523+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:55:05.178523+0000","last_undegraded":"2023-10-06T03:55:05.178523+0000","last_fullsized":"2023-10-06T03:55:05.178523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":479912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":207,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":959824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":1193661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.1299999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.175}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.212},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.2609999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.1659999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.2010000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.016}]},{"osd":5,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":1.024,"5min":1.024,"15min":1.024},"max":{"1min":2.2570000000000001,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.048}]},{"osd":7,"last update":"Fri Oct 6 03:54:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.081},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.101}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070132,"statfs":{"total":96636764160,"available":96327815168,"internally_reserved":0,"allocated":331776,"data_stored":130114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.056},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.1100000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81200000000000006}]},{"osd":2,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.024},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.25}]},{"osd":6,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.141},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0980000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:54:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.2150000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":608688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.73199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":1.2689999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.133}]},{"osd":5,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.202},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0580000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.3169999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.161},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.044}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":327680,"data_stored":129580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.024}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.3340000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.137},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.2709999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.3069999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.377},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.423}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.75}]},{"osd":3,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.999}]},{"osd":4,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.877},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.0669999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.171},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.131}]},{"osd":6,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.111}]},{"osd":7,"last update":"Fri Oct 6 03:54:33 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.274}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0940000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.76800000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.1479999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.228}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.0249999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1859999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":929792,"data_stored":725967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":1.087}]},{"osd":3,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.024}]},{"osd":4,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.149}]},{"osd":6,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.117}]},{"osd":7,"last update":"Fri Oct 6 03:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.21},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.0629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":479198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":473803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:55:25.569 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.569 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.569 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.569 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.569 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.570 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.571 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.572 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.573 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.574 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.575 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.576 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.577 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.578 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.578 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.578 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.578 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:25.578 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:55:33.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:55:33.139 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:55:45.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:55:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.690+0000 7fca9b59e700 1 Processor -- start 2023-10-06T03:55:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.690+0000 7fca9b59e700 1 -- start start 2023-10-06T03:55:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.690+0000 7fca9b59e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca9c0b0930 0x7fca9c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.690+0000 7fca9b59e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c0b20e0 con 0x7fca9c0b0d00 2023-10-06T03:55:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.690+0000 7fca9b59e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9c142310 con 0x7fca9c0b3490 2023-10-06T03:55:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9c13cad0 con 0x7fca9c0b0930 2023-10-06T03:55:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca9c0b0d00 0x7fca9c0b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:35544/0 (socket says 172.21.15.57:35544) 2023-10-06T03:55:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 -- 172.21.15.57:0/1694824534 learned_addr learned my addr 172.21.15.57:0/1694824534 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:55:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9a59c700 1 --2- 172.21.15.57:0/1694824534 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0b0930 0x7fca9c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921948287 0 0) 0x7fca9c0b20e0 con 0x7fca9c0b0d00 2023-10-06T03:55:45.698 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca84003570 con 0x7fca9c0b0d00 2023-10-06T03:55:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564173124 0 0) 0x7fca9c142310 con 0x7fca9c0b3490 2023-10-06T03:55:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca9c0b20e0 con 0x7fca9c0b3490 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778116248 0 0) 0x7fca84003570 con 0x7fca9c0b0d00 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0b0930 msgr2=0x7fca9c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 --2- 172.21.15.57:0/1694824534 >> v2:172.21.15.105:3300/0 conn(0x7fca9c0b0930 0x7fca9c142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 >> v1:172.21.15.105:6789/0 conn(0x7fca9c0b3490 legacy=0x7fca9c0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c1425d0 con 0x7fca9c0b0d00 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7fca8c001470 con 0x7fca9c0b0d00 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 >> v1:172.21.15.57:6789/0 conn(0x7fca9c0b0d00 legacy=0x7fca9c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca84003bf0 0x7fca84003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca840051c0 0x7fca8400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c13cad0 con 0x7fca84004810 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8400c160 con 0x7fca84003bf0 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8400c320 con 0x7fca840051c0 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9a59c700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca84003bf0 0x7fca84003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9ad9d700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca840051c0 0x7fca8400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 -- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca840051c0 msgr2=0x7fca8400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca840051c0 0x7fca8400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 -- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca84003bf0 msgr2=0x7fca84003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca84003bf0 0x7fca84003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 -- 172.21.15.57:0/1694824534 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84003570 con 0x7fca84004810 2023-10-06T03:55:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9ad9d700 1 -- 172.21.15.57:0/1694824534 reap_dead start 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca99d9b700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca84004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c2a0 tx=0x7fca8c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ae50f123d17e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c00cb90 con 0x7fca84004810 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00ccf0 con 0x7fca84004810 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9959a700 1 -- 172.21.15.57:0/1694824534 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005b70 con 0x7fca84004810 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 -- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 msgr2=0x7fca84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca84004c80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c2a0 tx=0x7fca8c001e10 comp rx=0 tx=0).stop 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 -- 172.21.15.57:0/1694824534 shutdown_connections 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 --2- 172.21.15.57:0/1694824534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca84004c80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.694+0000 7fca9b59e700 1 -- 172.21.15.57:0/1694824534 >> 172.21.15.57:0/1694824534 conn(0x7fca9c068f20 msgr2=0x7fca9c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- 172.21.15.57:0/1694824534 shutdown_connections 2023-10-06T03:55:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- 172.21.15.57:0/1694824534 wait complete. 2023-10-06T03:55:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 Processor -- start 2023-10-06T03:55:45.705 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- start start 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 0x7fca9c13a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c156490 0x7fca9c13ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c1558b0 con 0x7fca84004810 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c155b90 con 0x7fca9c156490 2023-10-06T03:55:45.706 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9b59e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c143680 con 0x7fca9c156020 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:53466/0 (socket says 172.21.15.57:53466) 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 -- 172.21.15.57:0/3328330570 learned_addr learned my addr 172.21.15.57:0/3328330570 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca99d9b700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 0x7fca9c13a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9ad9d700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c156490 0x7fca9c13ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 -- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 msgr2=0x7fca9c13a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 0x7fca9c13a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 -- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c156490 msgr2=0x7fca9c13ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c156490 0x7fca9c13ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 -- 172.21.15.57:0/3328330570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c143960 con 0x7fca84004810 2023-10-06T03:55:45.710 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca99d9b700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 0x7fca9c13a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.698+0000 7fca9a59c700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca90011a40 tx=0x7fca900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000f940 con 0x7fca84004810 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000faa0 con 0x7fca84004810 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c0add20 con 0x7fca84004810 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000fe20 con 0x7fca84004810 2023-10-06T03:55:45.711 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c0b78d0 con 0x7fca84004810 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c06a300 con 0x7fca84004810 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fca90014650 con 0x7fca84004810 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fca90018030 con 0x7fca84004810 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.702+0000 7fca99d9b700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:55:45.712 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.706+0000 7fca99d9b700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 0x7fca7c062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca8c008fd0 tx=0x7fca8c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:55:45.716 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.710+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca9004d660 con 0x7fca84004810 2023-10-06T03:55:45.878 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.874+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca9c155cd0 con 0x7fca7c060550 2023-10-06T03:55:45.897 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.894+0000 7fca8a7fc700 1 -- 172.21.15.57:0/3328330570 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311324 (secure 0 0 0) 0x7fca8c00ce60 con 0x7fca7c060550 2023-10-06T03:55:45.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:55:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 msgr2=0x7fca7c062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.906 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 0x7fca7c062a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fca8c008fd0 tx=0x7fca8c015000 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 msgr2=0x7fca9c0ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca90011a40 tx=0x7fca900091a0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 shutdown_connections 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fca7c060550 0x7fca7c062a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca9c156490 0x7fca9c13ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca9c156020 0x7fca9c13a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 --2- 172.21.15.57:0/3328330570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca84004810 0x7fca9c0ae4a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:55:45.907 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 >> 172.21.15.57:0/3328330570 conn(0x7fca9c068f20 msgr2=0x7fca9c13cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:55:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 shutdown_connections 2023-10-06T03:55:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:55:45.898+0000 7fca9b59e700 1 -- 172.21.15.57:0/3328330570 wait complete. 2023-10-06T03:55:45.908 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:55:45.917 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-06T03:55:44.671055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070280,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":416,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2429,"ondisk_log_size":2429,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403472,"kb_used_data":4688,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571248,"statfs":{"total":773094113280,"available":770632957952,"internally_reserved":0,"allocated":4800512,"data_stored":3176480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004847"},"pg_stats":[{"pgid":"4.3f","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.744705+0000","last_change":"2023-10-06T03:55:12.744584+0000","last_active":"2023-10-06T03:55:12.744705+0000","last_peered":"2023-10-06T03:55:12.744705+0000","last_clean":"2023-10-06T03:55:12.744705+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:55:12.744705+0000","last_undegraded":"2023-10-06T03:55:12.744705+0000","last_fullsized":"2023-10-06T03:55:12.744705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.744297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:23.844802+0000","scrub_duration":0.003817993,"objects_trimmed":0,"snaptrim_duration":0.0072822820000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.308893+0000","last_change":"2023-10-06T03:55:33.308839+0000","last_active":"2023-10-06T03:55:33.308893+0000","last_peered":"2023-10-06T03:55:33.308893+0000","last_clean":"2023-10-06T03:55:33.308893+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:55:33.308893+0000","last_undegraded":"2023-10-06T03:55:33.308893+0000","last_fullsized":"2023-10-06T03:55:33.308893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.308622+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:40.078317+0000","scrub_duration":0.0047154930000000003,"objects_trimmed":0,"snaptrim_duration":0.0099787499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181400+0000","last_change":"2023-10-06T03:55:00.655711+0000","last_active":"2023-10-06T03:55:10.181400+0000","last_peered":"2023-10-06T03:55:10.181400+0000","last_clean":"2023-10-06T03:55:10.181400+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:55:10.181400+0000","last_undegraded":"2023-10-06T03:55:10.181400+0000","last_fullsized":"2023-10-06T03:55:10.181400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016761273,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.333432+0000","last_change":"2023-10-06T03:55:36.333314+0000","last_active":"2023-10-06T03:55:36.333432+0000","last_peered":"2023-10-06T03:55:36.333432+0000","last_clean":"2023-10-06T03:55:36.333432+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:55:36.333432+0000","last_undegraded":"2023-10-06T03:55:36.333432+0000","last_fullsized":"2023-10-06T03:55:36.333432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.333033+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:43.250275+0000","scrub_duration":0.0043010030000000003,"objects_trimmed":0,"snaptrim_duration":0.0063584109999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:31.524244+0000","last_change":"2023-10-06T03:55:31.524167+0000","last_active":"2023-10-06T03:55:31.524244+0000","last_peered":"2023-10-06T03:55:31.524244+0000","last_clean":"2023-10-06T03:55:31.524244+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:55:31.524244+0000","last_undegraded":"2023-10-06T03:55:31.524244+0000","last_fullsized":"2023-10-06T03:55:31.524244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_clean_scrub_stamp":"2023-10-06T03:55:31.523839+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:39.553275+0000","scrub_duration":0.0040562519999999998,"objects_trimmed":0,"snaptrim_duration":0.010010550999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180101+0000","last_change":"2023-10-06T03:55:00.654853+0000","last_active":"2023-10-06T03:55:10.180101+0000","last_peered":"2023-10-06T03:55:10.180101+0000","last_clean":"2023-10-06T03:55:10.180101+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:55:10.180101+0000","last_undegraded":"2023-10-06T03:55:10.180101+0000","last_fullsized":"2023-10-06T03:55:10.180101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017107009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'22","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239448+0000","last_change":"2023-10-06T03:55:00.479572+0000","last_active":"2023-10-06T03:55:10.239448+0000","last_peered":"2023-10-06T03:55:10.239448+0000","last_clean":"2023-10-06T03:55:10.239448+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:55:10.239448+0000","last_undegraded":"2023-10-06T03:55:10.239448+0000","last_fullsized":"2023-10-06T03:55:10.239448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044403079999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.327041+0000","last_change":"2023-10-06T03:55:35.327007+0000","last_active":"2023-10-06T03:55:35.327041+0000","last_peered":"2023-10-06T03:55:35.327041+0000","last_clean":"2023-10-06T03:55:35.327041+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:55:35.327041+0000","last_undegraded":"2023-10-06T03:55:35.327041+0000","last_fullsized":"2023-10-06T03:55:35.327041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.326856+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:52.589771+0000","scrub_duration":0.0029891750000000002,"objects_trimmed":0,"snaptrim_duration":0.010671256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243895+0000","last_change":"2023-10-06T03:55:00.763893+0000","last_active":"2023-10-06T03:55:10.243895+0000","last_peered":"2023-10-06T03:55:10.243895+0000","last_clean":"2023-10-06T03:55:10.243895+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:55:10.243895+0000","last_undegraded":"2023-10-06T03:55:10.243895+0000","last_fullsized":"2023-10-06T03:55:10.243895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092769180000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'58","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.277410+0000","last_change":"2023-10-06T03:55:30.277342+0000","last_active":"2023-10-06T03:55:30.277410+0000","last_peered":"2023-10-06T03:55:30.277410+0000","last_clean":"2023-10-06T03:55:30.277410+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:55:30.277410+0000","last_undegraded":"2023-10-06T03:55:30.277410+0000","last_fullsized":"2023-10-06T03:55:30.277410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.277075+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:48.177630+0000","scrub_duration":0.0041351799999999996,"objects_trimmed":0,"snaptrim_duration":0.010557138000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.581076+0000","last_change":"2023-10-06T03:55:16.580993+0000","last_active":"2023-10-06T03:55:16.581076+0000","last_peered":"2023-10-06T03:55:16.581076+0000","last_clean":"2023-10-06T03:55:16.581076+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:55:16.581076+0000","last_undegraded":"2023-10-06T03:55:16.581076+0000","last_fullsized":"2023-10-06T03:55:16.581076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.580732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:29.697352+0000","scrub_duration":0.0043988070000000002,"objects_trimmed":0,"snaptrim_duration":0.017044597000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:18.844477+0000","last_change":"2023-10-06T03:55:18.844353+0000","last_active":"2023-10-06T03:55:18.844477+0000","last_peered":"2023-10-06T03:55:18.844477+0000","last_clean":"2023-10-06T03:55:18.844477+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:55:18.844477+0000","last_undegraded":"2023-10-06T03:55:18.844477+0000","last_fullsized":"2023-10-06T03:55:18.844477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_clean_scrub_stamp":"2023-10-06T03:55:18.844084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.508568+0000","scrub_duration":0.0043501169999999997,"objects_trimmed":0,"snaptrim_duration":0.0069042510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178061+0000","last_change":"2023-10-06T03:55:05.759217+0000","last_active":"2023-10-06T03:55:10.178061+0000","last_peered":"2023-10-06T03:55:10.178061+0000","last_clean":"2023-10-06T03:55:10.178061+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:55:10.178061+0000","last_undegraded":"2023-10-06T03:55:10.178061+0000","last_fullsized":"2023-10-06T03:55:10.178061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.759109+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.428927+0000","scrub_duration":0.010541894,"objects_trimmed":0,"snaptrim_duration":0.006884589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'36","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.305313+0000","last_change":"2023-10-06T03:55:24.305239+0000","last_active":"2023-10-06T03:55:24.305313+0000","last_peered":"2023-10-06T03:55:24.305313+0000","last_clean":"2023-10-06T03:55:24.305313+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:55:24.305313+0000","last_undegraded":"2023-10-06T03:55:24.305313+0000","last_fullsized":"2023-10-06T03:55:24.305313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.304974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:28.003511+0000","scrub_duration":0.0047502239999999999,"objects_trimmed":0,"snaptrim_duration":0.010166412,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240438+0000","last_change":"2023-10-06T03:55:00.479621+0000","last_active":"2023-10-06T03:55:10.240438+0000","last_peered":"2023-10-06T03:55:10.240438+0000","last_clean":"2023-10-06T03:55:10.240438+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:55:10.240438+0000","last_undegraded":"2023-10-06T03:55:10.240438+0000","last_fullsized":"2023-10-06T03:55:10.240438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042743499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'40","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178248+0000","last_change":"2023-10-06T03:55:00.653680+0000","last_active":"2023-10-06T03:55:10.178248+0000","last_peered":"2023-10-06T03:55:10.178248+0000","last_clean":"2023-10-06T03:55:10.178248+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:55:10.178248+0000","last_undegraded":"2023-10-06T03:55:10.178248+0000","last_fullsized":"2023-10-06T03:55:10.178248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016525431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'32","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.536276+0000","last_change":"2023-10-06T03:55:36.536204+0000","last_active":"2023-10-06T03:55:36.536276+0000","last_peered":"2023-10-06T03:55:36.536276+0000","last_clean":"2023-10-06T03:55:36.536276+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:55:36.536276+0000","last_undegraded":"2023-10-06T03:55:36.536276+0000","last_fullsized":"2023-10-06T03:55:36.536276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.535946+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:01.791835+0000","scrub_duration":0.0039438490000000001,"objects_trimmed":0,"snaptrim_duration":0.0096482700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'49","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181517+0000","last_change":"2023-10-06T03:55:00.656823+0000","last_active":"2023-10-06T03:55:10.181517+0000","last_peered":"2023-10-06T03:55:10.181517+0000","last_clean":"2023-10-06T03:55:10.181517+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:55:10.181517+0000","last_undegraded":"2023-10-06T03:55:10.181517+0000","last_fullsized":"2023-10-06T03:55:10.181517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171402999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.756421+0000","last_change":"2023-10-06T03:55:10.756346+0000","last_active":"2023-10-06T03:55:10.756421+0000","last_peered":"2023-10-06T03:55:10.756421+0000","last_clean":"2023-10-06T03:55:10.756421+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:55:10.756421+0000","last_undegraded":"2023-10-06T03:55:10.756421+0000","last_fullsized":"2023-10-06T03:55:10.756421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_clean_scrub_stamp":"2023-10-06T03:55:10.756040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.124413+0000","scrub_duration":0.0040958310000000003,"objects_trimmed":0,"snaptrim_duration":0.0063946960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181212+0000","last_change":"2023-10-06T03:55:00.656042+0000","last_active":"2023-10-06T03:55:10.181212+0000","last_peered":"2023-10-06T03:55:10.181212+0000","last_clean":"2023-10-06T03:55:10.181212+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:55:10.181212+0000","last_undegraded":"2023-10-06T03:55:10.181212+0000","last_fullsized":"2023-10-06T03:55:10.181212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017011842999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'44","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.240970+0000","last_change":"2023-10-06T03:55:00.480023+0000","last_active":"2023-10-06T03:55:10.240970+0000","last_peered":"2023-10-06T03:55:10.240970+0000","last_clean":"2023-10-06T03:55:10.240970+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:55:10.240970+0000","last_undegraded":"2023-10-06T03:55:10.240970+0000","last_fullsized":"2023-10-06T03:55:10.240970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045883720000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.504426+0000","last_change":"2023-10-06T03:55:29.504313+0000","last_active":"2023-10-06T03:55:29.504426+0000","last_peered":"2023-10-06T03:55:29.504426+0000","last_clean":"2023-10-06T03:55:29.504426+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:55:29.504426+0000","last_undegraded":"2023-10-06T03:55:29.504426+0000","last_fullsized":"2023-10-06T03:55:29.504426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.503976+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:34.797716+0000","scrub_duration":0.0038718749999999999,"objects_trimmed":0,"snaptrim_duration":0.010470313,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243810+0000","last_change":"2023-10-06T03:55:00.781344+0000","last_active":"2023-10-06T03:55:10.243810+0000","last_peered":"2023-10-06T03:55:10.243810+0000","last_clean":"2023-10-06T03:55:10.243810+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:55:10.243810+0000","last_undegraded":"2023-10-06T03:55:10.243810+0000","last_fullsized":"2023-10-06T03:55:10.243810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092240970000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'31","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.239713+0000","last_change":"2023-10-06T03:55:00.479157+0000","last_active":"2023-10-06T03:55:10.239713+0000","last_peered":"2023-10-06T03:55:10.239713+0000","last_clean":"2023-10-06T03:55:10.239713+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:55:10.239713+0000","last_undegraded":"2023-10-06T03:55:10.239713+0000","last_fullsized":"2023-10-06T03:55:10.239713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042144280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:38.561913+0000","last_change":"2023-10-06T03:55:38.561838+0000","last_active":"2023-10-06T03:55:38.561913+0000","last_peered":"2023-10-06T03:55:38.561913+0000","last_clean":"2023-10-06T03:55:38.561913+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:55:38.561913+0000","last_undegraded":"2023-10-06T03:55:38.561913+0000","last_fullsized":"2023-10-06T03:55:38.561913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_clean_scrub_stamp":"2023-10-06T03:55:38.561562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.855302+0000","scrub_duration":0.0041220800000000002,"objects_trimmed":0,"snaptrim_duration":0.010852538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'53","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.631821+0000","last_change":"2023-10-06T03:55:29.631754+0000","last_active":"2023-10-06T03:55:29.631821+0000","last_peered":"2023-10-06T03:55:29.631821+0000","last_clean":"2023-10-06T03:55:29.631821+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:55:29.631821+0000","last_undegraded":"2023-10-06T03:55:29.631821+0000","last_fullsized":"2023-10-06T03:55:29.631821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.631489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:42.748108+0000","scrub_duration":0.0040588150000000003,"objects_trimmed":0,"snaptrim_duration":0.0096577650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.342874+0000","last_change":"2023-10-06T03:55:32.342809+0000","last_active":"2023-10-06T03:55:32.342874+0000","last_peered":"2023-10-06T03:55:32.342874+0000","last_clean":"2023-10-06T03:55:32.342874+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:55:32.342874+0000","last_undegraded":"2023-10-06T03:55:32.342874+0000","last_fullsized":"2023-10-06T03:55:32.342874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.342538+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:38.710724+0000","scrub_duration":0.0042552450000000004,"objects_trimmed":0,"snaptrim_duration":0.0097876560000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.597821+0000","last_change":"2023-10-06T03:55:33.597725+0000","last_active":"2023-10-06T03:55:33.597821+0000","last_peered":"2023-10-06T03:55:33.597821+0000","last_clean":"2023-10-06T03:55:33.597821+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:55:33.597821+0000","last_undegraded":"2023-10-06T03:55:33.597821+0000","last_fullsized":"2023-10-06T03:55:33.597821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.597471+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:23.977067+0000","scrub_duration":0.0041129490000000003,"objects_trimmed":0,"snaptrim_duration":0.010385257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.069301+0000","last_change":"2023-10-06T03:55:35.069234+0000","last_active":"2023-10-06T03:55:35.069301+0000","last_peered":"2023-10-06T03:55:35.069301+0000","last_clean":"2023-10-06T03:55:35.069301+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:55:35.069301+0000","last_undegraded":"2023-10-06T03:55:35.069301+0000","last_fullsized":"2023-10-06T03:55:35.069301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.068954+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:43.098390+0000","scrub_duration":0.0045654429999999998,"objects_trimmed":0,"snaptrim_duration":0.0091510959999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180518+0000","last_change":"2023-10-06T03:55:04.638303+0000","last_active":"2023-10-06T03:55:10.180518+0000","last_peered":"2023-10-06T03:55:10.180518+0000","last_clean":"2023-10-06T03:55:10.180518+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:55:10.180518+0000","last_undegraded":"2023-10-06T03:55:10.180518+0000","last_fullsized":"2023-10-06T03:55:10.180518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.638053+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:02.084340+0000","scrub_duration":0.0042471119999999999,"objects_trimmed":0,"snaptrim_duration":0.017042165000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'43","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244404+0000","last_change":"2023-10-06T03:55:00.782891+0000","last_active":"2023-10-06T03:55:10.244404+0000","last_peered":"2023-10-06T03:55:10.244404+0000","last_clean":"2023-10-06T03:55:10.244404+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:55:10.244404+0000","last_undegraded":"2023-10-06T03:55:10.244404+0000","last_fullsized":"2023-10-06T03:55:10.244404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010478619,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.362644+0000","last_change":"2023-10-06T03:55:35.362577+0000","last_active":"2023-10-06T03:55:35.362644+0000","last_peered":"2023-10-06T03:55:35.362644+0000","last_clean":"2023-10-06T03:55:35.362644+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:55:35.362644+0000","last_undegraded":"2023-10-06T03:55:35.362644+0000","last_fullsized":"2023-10-06T03:55:35.362644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.362319+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:48.478939+0000","scrub_duration":0.0041746999999999999,"objects_trimmed":0,"snaptrim_duration":0.007180461,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'44","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.058107+0000","last_change":"2023-10-06T03:55:40.058037+0000","last_active":"2023-10-06T03:55:40.058107+0000","last_peered":"2023-10-06T03:55:40.058107+0000","last_clean":"2023-10-06T03:55:40.058107+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:55:40.058107+0000","last_undegraded":"2023-10-06T03:55:40.058107+0000","last_fullsized":"2023-10-06T03:55:40.058107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.057731+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:05.313619+0000","scrub_duration":0.0036339419999999998,"objects_trimmed":0,"snaptrim_duration":0.010865144,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.586469+0000","last_change":"2023-10-06T03:55:25.586350+0000","last_active":"2023-10-06T03:55:25.586469+0000","last_peered":"2023-10-06T03:55:25.586469+0000","last_clean":"2023-10-06T03:55:25.586469+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:55:25.586469+0000","last_undegraded":"2023-10-06T03:55:25.586469+0000","last_fullsized":"2023-10-06T03:55:25.586469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.586087+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:38.702706+0000","scrub_duration":0.0086854250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.319007+0000","last_change":"2023-10-06T03:55:25.318947+0000","last_active":"2023-10-06T03:55:25.319007+0000","last_peered":"2023-10-06T03:55:25.319007+0000","last_clean":"2023-10-06T03:55:25.319007+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:55:25.319007+0000","last_undegraded":"2023-10-06T03:55:25.319007+0000","last_fullsized":"2023-10-06T03:55:25.319007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.318651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:51.036219+0000","scrub_duration":0.0041645750000000002,"objects_trimmed":0,"snaptrim_duration":0.0097426309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.509563+0000","last_change":"2023-10-06T03:55:12.509433+0000","last_active":"2023-10-06T03:55:12.509563+0000","last_peered":"2023-10-06T03:55:12.509563+0000","last_clean":"2023-10-06T03:55:12.509563+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:55:12.509563+0000","last_undegraded":"2023-10-06T03:55:12.509563+0000","last_fullsized":"2023-10-06T03:55:12.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.509162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:45.173964+0000","scrub_duration":0.004617454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.546069+0000","last_change":"2023-10-06T03:55:30.546003+0000","last_active":"2023-10-06T03:55:30.546069+0000","last_peered":"2023-10-06T03:55:30.546069+0000","last_clean":"2023-10-06T03:55:30.546069+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:55:30.546069+0000","last_undegraded":"2023-10-06T03:55:30.546069+0000","last_fullsized":"2023-10-06T03:55:30.546069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.545739+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.910393+0000","scrub_duration":0.0038579909999999999,"objects_trimmed":0,"snaptrim_duration":0.0097705469999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.612194+0000","last_change":"2023-10-06T03:55:19.612128+0000","last_active":"2023-10-06T03:55:19.612194+0000","last_peered":"2023-10-06T03:55:19.612194+0000","last_clean":"2023-10-06T03:55:19.612194+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:55:19.612194+0000","last_undegraded":"2023-10-06T03:55:19.612194+0000","last_fullsized":"2023-10-06T03:55:19.612194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.611867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:23.143979+0000","scrub_duration":0.0039385999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'38","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.246865+0000","last_change":"2023-10-06T03:55:00.784450+0000","last_active":"2023-10-06T03:55:10.246865+0000","last_peered":"2023-10-06T03:55:10.246865+0000","last_clean":"2023-10-06T03:55:10.246865+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:55:10.246865+0000","last_undegraded":"2023-10-06T03:55:10.246865+0000","last_fullsized":"2023-10-06T03:55:10.246865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01003823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"30'13","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:11.262927+0000","last_change":"2023-10-06T03:55:11.262836+0000","last_active":"2023-10-06T03:55:11.262927+0000","last_peered":"2023-10-06T03:55:11.262927+0000","last_clean":"2023-10-06T03:55:11.262927+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:55:11.262927+0000","last_undegraded":"2023-10-06T03:55:11.262927+0000","last_fullsized":"2023-10-06T03:55:11.262927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_clean_scrub_stamp":"2023-10-06T03:55:11.262564+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.630938+0000","scrub_duration":0.010133995999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.627061+0000","last_change":"2023-10-06T03:55:35.627061+0000","last_active":"2023-10-06T03:55:35.627061+0000","last_peered":"2023-10-06T03:55:35.627061+0000","last_clean":"2023-10-06T03:55:35.627061+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:55:35.627061+0000","last_undegraded":"2023-10-06T03:55:35.627061+0000","last_fullsized":"2023-10-06T03:55:35.627061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:42.610498+0000","last_clean_scrub_stamp":"2023-10-06T03:53:42.610498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.280506+0000","last_change":"2023-10-06T03:55:23.280427+0000","last_active":"2023-10-06T03:55:23.280506+0000","last_peered":"2023-10-06T03:55:23.280506+0000","last_clean":"2023-10-06T03:55:23.280506+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:55:23.280506+0000","last_undegraded":"2023-10-06T03:55:23.280506+0000","last_fullsized":"2023-10-06T03:55:23.280506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.280171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:28.862189+0000","scrub_duration":0.0036857880000000002,"objects_trimmed":0,"snaptrim_duration":0.010236192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.573120+0000","last_change":"2023-10-06T03:55:26.573033+0000","last_active":"2023-10-06T03:55:26.573120+0000","last_peered":"2023-10-06T03:55:26.573120+0000","last_clean":"2023-10-06T03:55:26.573120+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:55:26.573120+0000","last_undegraded":"2023-10-06T03:55:26.573120+0000","last_fullsized":"2023-10-06T03:55:26.573120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.572789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:33.490031+0000","scrub_duration":0.0067112960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'10","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178359+0000","last_change":"2023-10-06T03:55:00.654289+0000","last_active":"2023-10-06T03:55:10.178359+0000","last_peered":"2023-10-06T03:55:10.178359+0000","last_clean":"2023-10-06T03:55:10.178359+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:55:10.178359+0000","last_undegraded":"2023-10-06T03:55:10.178359+0000","last_fullsized":"2023-10-06T03:55:10.178359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.016897651999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.658046+0000","last_change":"2023-10-06T03:55:34.657973+0000","last_active":"2023-10-06T03:55:34.658046+0000","last_peered":"2023-10-06T03:55:34.658046+0000","last_clean":"2023-10-06T03:55:34.658046+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:55:34.658046+0000","last_undegraded":"2023-10-06T03:55:34.658046+0000","last_fullsized":"2023-10-06T03:55:34.658046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.657722+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:21.606660+0000","scrub_duration":0.0072249790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.365499+0000","last_change":"2023-10-06T03:55:28.365395+0000","last_active":"2023-10-06T03:55:28.365499+0000","last_peered":"2023-10-06T03:55:28.365499+0000","last_clean":"2023-10-06T03:55:28.365499+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:55:28.365499+0000","last_undegraded":"2023-10-06T03:55:28.365499+0000","last_fullsized":"2023-10-06T03:55:28.365499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.365138+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:01.029940+0000","scrub_duration":0.0043556419999999998,"objects_trimmed":0,"snaptrim_duration":0.0063459989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.380585+0000","last_change":"2023-10-06T03:55:06.380488+0000","last_active":"2023-10-06T03:55:06.380585+0000","last_peered":"2023-10-06T03:55:06.380585+0000","last_clean":"2023-10-06T03:55:06.380585+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:55:06.380585+0000","last_undegraded":"2023-10-06T03:55:06.380585+0000","last_fullsized":"2023-10-06T03:55:06.380585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.380239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:10.084652+0000","scrub_duration":0.0039703960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'39","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242236+0000","last_change":"2023-10-06T03:55:00.762223+0000","last_active":"2023-10-06T03:55:10.242236+0000","last_peered":"2023-10-06T03:55:10.242236+0000","last_clean":"2023-10-06T03:55:10.242236+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:55:10.242236+0000","last_undegraded":"2023-10-06T03:55:10.242236+0000","last_fullsized":"2023-10-06T03:55:10.242236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0091432119999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.703876+0000","last_change":"2023-10-06T03:55:16.703748+0000","last_active":"2023-10-06T03:55:16.703876+0000","last_peered":"2023-10-06T03:55:16.703876+0000","last_clean":"2023-10-06T03:55:16.703876+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:55:16.703876+0000","last_undegraded":"2023-10-06T03:55:16.703876+0000","last_fullsized":"2023-10-06T03:55:16.703876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.703443+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:49.368245+0000","scrub_duration":0.011084629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.656552+0000","last_change":"2023-10-06T03:55:40.656426+0000","last_active":"2023-10-06T03:55:40.656552+0000","last_peered":"2023-10-06T03:55:40.656552+0000","last_clean":"2023-10-06T03:55:40.656552+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:55:40.656552+0000","last_undegraded":"2023-10-06T03:55:40.656552+0000","last_fullsized":"2023-10-06T03:55:40.656552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.656149+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.110491+0000","scrub_duration":0.0040888000000000001,"objects_trimmed":0,"snaptrim_duration":0.017145036999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.301487+0000","last_change":"2023-10-06T03:55:13.301391+0000","last_active":"2023-10-06T03:55:13.301487+0000","last_peered":"2023-10-06T03:55:13.301487+0000","last_clean":"2023-10-06T03:55:13.301487+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:55:13.301487+0000","last_undegraded":"2023-10-06T03:55:13.301487+0000","last_fullsized":"2023-10-06T03:55:13.301487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.301122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:24.401627+0000","scrub_duration":0.0044995039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'29","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181819+0000","last_change":"2023-10-06T03:55:00.656528+0000","last_active":"2023-10-06T03:55:10.181819+0000","last_peered":"2023-10-06T03:55:10.181819+0000","last_clean":"2023-10-06T03:55:10.181819+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:55:10.181819+0000","last_undegraded":"2023-10-06T03:55:10.181819+0000","last_fullsized":"2023-10-06T03:55:10.181819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017135524999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.634668+0000","last_change":"2023-10-06T03:55:20.634606+0000","last_active":"2023-10-06T03:55:20.634668+0000","last_peered":"2023-10-06T03:55:20.634668+0000","last_clean":"2023-10-06T03:55:20.634668+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:55:20.634668+0000","last_undegraded":"2023-10-06T03:55:20.634668+0000","last_fullsized":"2023-10-06T03:55:20.634668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.634345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:11.013941+0000","scrub_duration":0.0041101649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.629081+0000","last_change":"2023-10-06T03:55:35.628954+0000","last_active":"2023-10-06T03:55:35.629081+0000","last_peered":"2023-10-06T03:55:35.629081+0000","last_clean":"2023-10-06T03:55:35.629081+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:55:35.629081+0000","last_undegraded":"2023-10-06T03:55:35.629081+0000","last_fullsized":"2023-10-06T03:55:35.629081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.628683+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:14.448761+0000","scrub_duration":0.0037000319999999998,"objects_trimmed":0,"snaptrim_duration":0.017297254000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:08.771338+0000","last_change":"2023-10-06T03:55:08.771121+0000","last_active":"2023-10-06T03:55:08.771338+0000","last_peered":"2023-10-06T03:55:08.771338+0000","last_clean":"2023-10-06T03:55:08.771338+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:55:08.771338+0000","last_undegraded":"2023-10-06T03:55:08.771338+0000","last_fullsized":"2023-10-06T03:55:08.771338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_clean_scrub_stamp":"2023-10-06T03:55:08.770817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:34.435300+0000","scrub_duration":0.0040354609999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:37.545844+0000","last_change":"2023-10-06T03:55:37.545705+0000","last_active":"2023-10-06T03:55:37.545844+0000","last_peered":"2023-10-06T03:55:37.545844+0000","last_clean":"2023-10-06T03:55:37.545844+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:55:37.545844+0000","last_undegraded":"2023-10-06T03:55:37.545844+0000","last_fullsized":"2023-10-06T03:55:37.545844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_clean_scrub_stamp":"2023-10-06T03:55:37.545413+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:24.494352+0000","scrub_duration":0.0038541280000000001,"objects_trimmed":0,"snaptrim_duration":0.0099655790000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.640255+0000","last_change":"2023-10-06T03:55:07.640070+0000","last_active":"2023-10-06T03:55:07.640255+0000","last_peered":"2023-10-06T03:55:07.640255+0000","last_clean":"2023-10-06T03:55:07.640255+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:55:07.640255+0000","last_undegraded":"2023-10-06T03:55:07.640255+0000","last_fullsized":"2023-10-06T03:55:07.640255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.639807+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.740312+0000","scrub_duration":0.013574480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.382170+0000","last_change":"2023-10-06T03:55:05.381563+0000","last_active":"2023-10-06T03:55:05.382170+0000","last_peered":"2023-10-06T03:55:05.382170+0000","last_clean":"2023-10-06T03:55:05.382170+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:55:05.382170+0000","last_undegraded":"2023-10-06T03:55:05.382170+0000","last_fullsized":"2023-10-06T03:55:05.382170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.381223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:37.257218+0000","scrub_duration":0.0045535489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:27.887604+0000","last_change":"2023-10-06T03:55:27.887534+0000","last_active":"2023-10-06T03:55:27.887604+0000","last_peered":"2023-10-06T03:55:27.887604+0000","last_clean":"2023-10-06T03:55:27.887604+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:55:27.887604+0000","last_undegraded":"2023-10-06T03:55:27.887604+0000","last_fullsized":"2023-10-06T03:55:27.887604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_clean_scrub_stamp":"2023-10-06T03:55:27.887241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:18.266837+0000","scrub_duration":0.0040139879999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.267114+0000","last_change":"2023-10-06T03:55:19.266995+0000","last_active":"2023-10-06T03:55:19.267114+0000","last_peered":"2023-10-06T03:55:19.267114+0000","last_clean":"2023-10-06T03:55:19.267114+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:55:19.267114+0000","last_undegraded":"2023-10-06T03:55:19.267114+0000","last_fullsized":"2023-10-06T03:55:19.267114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.266595+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.931079+0000","scrub_duration":0.004022856,"objects_trimmed":0,"snaptrim_duration":0.006907687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.633309+0000","last_change":"2023-10-06T03:55:12.633170+0000","last_active":"2023-10-06T03:55:12.633309+0000","last_peered":"2023-10-06T03:55:12.633309+0000","last_clean":"2023-10-06T03:55:12.633309+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:55:12.633309+0000","last_undegraded":"2023-10-06T03:55:12.633309+0000","last_fullsized":"2023-10-06T03:55:12.633309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.632897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:38.297380+0000","scrub_duration":0.005677596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.486436+0000","last_change":"2023-10-06T03:55:19.486358+0000","last_active":"2023-10-06T03:55:19.486436+0000","last_peered":"2023-10-06T03:55:19.486436+0000","last_clean":"2023-10-06T03:55:19.486436+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:55:19.486436+0000","last_undegraded":"2023-10-06T03:55:19.486436+0000","last_fullsized":"2023-10-06T03:55:19.486436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.486077+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:32.602697+0000","scrub_duration":0.0050046780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'35","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244190+0000","last_change":"2023-10-06T03:55:00.764686+0000","last_active":"2023-10-06T03:55:10.244190+0000","last_peered":"2023-10-06T03:55:10.244190+0000","last_clean":"2023-10-06T03:55:10.244190+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:55:10.244190+0000","last_undegraded":"2023-10-06T03:55:10.244190+0000","last_fullsized":"2023-10-06T03:55:10.244190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0095532519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.388616+0000","last_change":"2023-10-06T03:55:03.796402+0000","last_active":"2023-10-06T03:55:05.388616+0000","last_peered":"2023-10-06T03:55:05.388616+0000","last_clean":"2023-10-06T03:55:05.388616+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:55:05.388616+0000","last_undegraded":"2023-10-06T03:55:05.388616+0000","last_fullsized":"2023-10-06T03:55:05.388616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_clean_scrub_stamp":"2023-10-06T03:55:03.796132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:06.103535+0000","scrub_duration":0.0035169239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.496877+0000","last_change":"2023-10-06T03:55:13.496803+0000","last_active":"2023-10-06T03:55:13.496877+0000","last_peered":"2023-10-06T03:55:13.496877+0000","last_clean":"2023-10-06T03:55:13.496877+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:55:13.496877+0000","last_undegraded":"2023-10-06T03:55:13.496877+0000","last_fullsized":"2023-10-06T03:55:13.496877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.496501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:39.160985+0000","scrub_duration":0.0059863599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.606531+0000","last_change":"2023-10-06T03:55:30.606439+0000","last_active":"2023-10-06T03:55:30.606531+0000","last_peered":"2023-10-06T03:55:30.606531+0000","last_clean":"2023-10-06T03:55:30.606531+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:55:30.606531+0000","last_undegraded":"2023-10-06T03:55:30.606531+0000","last_fullsized":"2023-10-06T03:55:30.606531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.606178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:37.523420+0000","scrub_duration":0.0047520510000000002,"objects_trimmed":0,"snaptrim_duration":0.010907283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.381440+0000","last_change":"2023-10-06T03:55:04.330738+0000","last_active":"2023-10-06T03:55:05.381440+0000","last_peered":"2023-10-06T03:55:05.381440+0000","last_clean":"2023-10-06T03:55:05.381440+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:55:05.381440+0000","last_undegraded":"2023-10-06T03:55:05.381440+0000","last_fullsized":"2023-10-06T03:55:05.381440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.330335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.964328+0000","scrub_duration":0.004180291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.570701+0000","last_change":"2023-10-06T03:55:24.570637+0000","last_active":"2023-10-06T03:55:24.570701+0000","last_peered":"2023-10-06T03:55:24.570701+0000","last_clean":"2023-10-06T03:55:24.570701+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:55:24.570701+0000","last_undegraded":"2023-10-06T03:55:24.570701+0000","last_fullsized":"2023-10-06T03:55:24.570701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.570374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:11.519312+0000","scrub_duration":0.0037479179999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'35","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.349129+0000","last_change":"2023-10-06T03:55:39.349071+0000","last_active":"2023-10-06T03:55:39.349129+0000","last_peered":"2023-10-06T03:55:39.349129+0000","last_clean":"2023-10-06T03:55:39.349129+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:55:39.349129+0000","last_undegraded":"2023-10-06T03:55:39.349129+0000","last_fullsized":"2023-10-06T03:55:39.349129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.348847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:56.849541+0000","scrub_duration":0.0038212530000000001,"objects_trimmed":0,"snaptrim_duration":0.010188835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.293117+0000","last_change":"2023-10-06T03:55:12.293033+0000","last_active":"2023-10-06T03:55:12.293117+0000","last_peered":"2023-10-06T03:55:12.293117+0000","last_clean":"2023-10-06T03:55:12.293117+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:55:12.293117+0000","last_undegraded":"2023-10-06T03:55:12.293117+0000","last_fullsized":"2023-10-06T03:55:12.293117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.292753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:14.664468+0000","scrub_duration":0.004434566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.520693+0000","last_change":"2023-10-06T03:55:07.520556+0000","last_active":"2023-10-06T03:55:07.520693+0000","last_peered":"2023-10-06T03:55:07.520693+0000","last_clean":"2023-10-06T03:55:07.520693+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:55:07.520693+0000","last_undegraded":"2023-10-06T03:55:07.520693+0000","last_fullsized":"2023-10-06T03:55:07.520693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.520348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.620853+0000","scrub_duration":0.003511218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.548926+0000","last_change":"2023-10-06T03:55:39.548799+0000","last_active":"2023-10-06T03:55:39.548926+0000","last_peered":"2023-10-06T03:55:39.548926+0000","last_clean":"2023-10-06T03:55:39.548926+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:55:39.548926+0000","last_undegraded":"2023-10-06T03:55:39.548926+0000","last_fullsized":"2023-10-06T03:55:39.548926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.548474+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:14.913128+0000","scrub_duration":0.0044120610000000001,"objects_trimmed":0,"snaptrim_duration":0.010698005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.458936+0000","last_change":"2023-10-06T03:55:16.458859+0000","last_active":"2023-10-06T03:55:16.458936+0000","last_peered":"2023-10-06T03:55:16.458936+0000","last_clean":"2023-10-06T03:55:16.458936+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:55:16.458936+0000","last_undegraded":"2023-10-06T03:55:16.458936+0000","last_fullsized":"2023-10-06T03:55:16.458936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.458563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:13.904851+0000","scrub_duration":0.0042922999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.633759+0000","last_change":"2023-10-06T03:55:13.633679+0000","last_active":"2023-10-06T03:55:13.633759+0000","last_peered":"2023-10-06T03:55:13.633759+0000","last_clean":"2023-10-06T03:55:13.633759+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:55:13.633759+0000","last_undegraded":"2023-10-06T03:55:13.633759+0000","last_fullsized":"2023-10-06T03:55:13.633759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.633435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:11.079723+0000","scrub_duration":0.004040732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'25","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.242290+0000","last_change":"2023-10-06T03:55:00.762424+0000","last_active":"2023-10-06T03:55:10.242290+0000","last_peered":"2023-10-06T03:55:10.242290+0000","last_clean":"2023-10-06T03:55:10.242290+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:55:10.242290+0000","last_undegraded":"2023-10-06T03:55:10.242290+0000","last_fullsized":"2023-10-06T03:55:10.242290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0093781690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.860757+0000","last_change":"2023-10-06T03:55:23.860690+0000","last_active":"2023-10-06T03:55:23.860757+0000","last_peered":"2023-10-06T03:55:23.860757+0000","last_clean":"2023-10-06T03:55:23.860757+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:55:23.860757+0000","last_undegraded":"2023-10-06T03:55:23.860757+0000","last_fullsized":"2023-10-06T03:55:23.860757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.860446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:36.977065+0000","scrub_duration":0.0090851030000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.506143+0000","last_change":"2023-10-06T03:55:05.502487+0000","last_active":"2023-10-06T03:55:05.506143+0000","last_peered":"2023-10-06T03:55:05.506143+0000","last_clean":"2023-10-06T03:55:05.506143+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:55:05.506143+0000","last_undegraded":"2023-10-06T03:55:05.506143+0000","last_fullsized":"2023-10-06T03:55:05.506143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.502231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:32.870605+0000","scrub_duration":0.0037392129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'38","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.026350+0000","last_change":"2023-10-06T03:55:34.026278+0000","last_active":"2023-10-06T03:55:34.026350+0000","last_peered":"2023-10-06T03:55:34.026350+0000","last_clean":"2023-10-06T03:55:34.026350+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:55:34.026350+0000","last_undegraded":"2023-10-06T03:55:34.026350+0000","last_fullsized":"2023-10-06T03:55:34.026350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.026024+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:09.390678+0000","scrub_duration":0.0046214760000000002,"objects_trimmed":0,"snaptrim_duration":0.010244603,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'6","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.456074+0000","last_change":"2023-10-06T03:55:06.455929+0000","last_active":"2023-10-06T03:55:06.456074+0000","last_peered":"2023-10-06T03:55:06.456074+0000","last_clean":"2023-10-06T03:55:06.456074+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:55:06.456074+0000","last_undegraded":"2023-10-06T03:55:06.456074+0000","last_fullsized":"2023-10-06T03:55:06.456074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.455659+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:32.120143+0000","scrub_duration":0.0048712210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.162781+0000","last_change":"2023-10-06T03:55:06.162696+0000","last_active":"2023-10-06T03:55:06.162781+0000","last_peered":"2023-10-06T03:55:06.162781+0000","last_clean":"2023-10-06T03:55:06.162781+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:55:06.162781+0000","last_undegraded":"2023-10-06T03:55:06.162781+0000","last_fullsized":"2023-10-06T03:55:06.162781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.162407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.832225+0000","scrub_duration":0.0036688609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179756+0000","last_change":"2023-10-06T03:55:09.636062+0000","last_active":"2023-10-06T03:55:10.179756+0000","last_peered":"2023-10-06T03:55:10.179756+0000","last_clean":"2023-10-06T03:55:10.179756+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:55:10.179756+0000","last_undegraded":"2023-10-06T03:55:10.179756+0000","last_fullsized":"2023-10-06T03:55:10.179756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_clean_scrub_stamp":"2023-10-06T03:55:09.635780+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:42.300582+0000","scrub_duration":0.0040873719999999997,"objects_trimmed":0,"snaptrim_duration":0.017171291000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'61","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:17.596116+0000","last_change":"2023-10-06T03:55:17.596047+0000","last_active":"2023-10-06T03:55:17.596116+0000","last_peered":"2023-10-06T03:55:17.596116+0000","last_clean":"2023-10-06T03:55:17.596116+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:55:17.596116+0000","last_undegraded":"2023-10-06T03:55:17.596116+0000","last_fullsized":"2023-10-06T03:55:17.596116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_clean_scrub_stamp":"2023-10-06T03:55:17.595793+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:24.513035+0000","scrub_duration":0.0039416820000000002,"objects_trimmed":0,"snaptrim_duration":0.016769477000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'135","reported_seq":161,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.626677+0000","last_change":"2023-10-06T03:55:25.626637+0000","last_active":"2023-10-06T03:55:25.626677+0000","last_peered":"2023-10-06T03:55:25.626677+0000","last_clean":"2023-10-06T03:55:25.626677+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:55:25.626677+0000","last_undegraded":"2023-10-06T03:55:25.626677+0000","last_fullsized":"2023-10-06T03:55:25.626677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'135","last_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_deep_scrub":"30'135","last_deep_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.626485+0000","objects_scrubbed":4,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:30.920225+0000","scrub_duration":0.013822174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473587,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'36","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.245774+0000","last_change":"2023-10-06T03:55:00.540434+0000","last_active":"2023-10-06T03:55:10.245774+0000","last_peered":"2023-10-06T03:55:10.245774+0000","last_clean":"2023-10-06T03:55:10.245774+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:55:10.245774+0000","last_undegraded":"2023-10-06T03:55:10.245774+0000","last_fullsized":"2023-10-06T03:55:10.245774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010103025,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'16","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.730215+0000","last_change":"2023-10-06T03:55:39.730095+0000","last_active":"2023-10-06T03:55:39.730215+0000","last_peered":"2023-10-06T03:55:39.730215+0000","last_clean":"2023-10-06T03:55:39.730215+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:55:39.730215+0000","last_undegraded":"2023-10-06T03:55:39.730215+0000","last_fullsized":"2023-10-06T03:55:39.730215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.729838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:47.759273+0000","scrub_duration":0.0091261050000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.345078+0000","last_change":"2023-10-06T03:55:07.344971+0000","last_active":"2023-10-06T03:55:07.345078+0000","last_peered":"2023-10-06T03:55:07.345078+0000","last_clean":"2023-10-06T03:55:07.345078+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:55:07.345078+0000","last_undegraded":"2023-10-06T03:55:07.345078+0000","last_fullsized":"2023-10-06T03:55:07.345078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.344686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:31.239949+0000","scrub_duration":0.004290271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'26","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.246798+0000","last_change":"2023-10-06T03:55:00.783055+0000","last_active":"2023-10-06T03:55:10.246798+0000","last_peered":"2023-10-06T03:55:10.246798+0000","last_clean":"2023-10-06T03:55:10.246798+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:55:10.246798+0000","last_undegraded":"2023-10-06T03:55:10.246798+0000","last_fullsized":"2023-10-06T03:55:10.246798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010254809,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.461561+0000","last_change":"2023-10-06T03:55:20.461433+0000","last_active":"2023-10-06T03:55:20.461561+0000","last_peered":"2023-10-06T03:55:20.461561+0000","last_clean":"2023-10-06T03:55:20.461561+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:55:20.461561+0000","last_undegraded":"2023-10-06T03:55:20.461561+0000","last_fullsized":"2023-10-06T03:55:20.461561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.461129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:27.378371+0000","scrub_duration":0.0050521910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'27","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.241276+0000","last_change":"2023-10-06T03:55:00.784344+0000","last_active":"2023-10-06T03:55:10.241276+0000","last_peered":"2023-10-06T03:55:10.241276+0000","last_clean":"2023-10-06T03:55:10.241276+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:55:10.241276+0000","last_undegraded":"2023-10-06T03:55:10.241276+0000","last_fullsized":"2023-10-06T03:55:10.241276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010824848999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.316781+0000","last_change":"2023-10-06T03:55:22.316719+0000","last_active":"2023-10-06T03:55:22.316781+0000","last_peered":"2023-10-06T03:55:22.316781+0000","last_clean":"2023-10-06T03:55:22.316781+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:55:22.316781+0000","last_undegraded":"2023-10-06T03:55:22.316781+0000","last_fullsized":"2023-10-06T03:55:22.316781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.316458+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:19.762745+0000","scrub_duration":0.0038390270000000001,"objects_trimmed":0,"snaptrim_duration":0.0072167000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.023492+0000","last_change":"2023-10-06T03:55:32.023425+0000","last_active":"2023-10-06T03:55:32.023492+0000","last_peered":"2023-10-06T03:55:32.023492+0000","last_clean":"2023-10-06T03:55:32.023492+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:55:32.023492+0000","last_undegraded":"2023-10-06T03:55:32.023492+0000","last_fullsized":"2023-10-06T03:55:32.023492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.023106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:18.972045+0000","scrub_duration":0.0039914340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'20","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.244094+0000","last_change":"2023-10-06T03:55:00.764287+0000","last_active":"2023-10-06T03:55:10.244094+0000","last_peered":"2023-10-06T03:55:10.244094+0000","last_clean":"2023-10-06T03:55:10.244094+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:55:10.244094+0000","last_undegraded":"2023-10-06T03:55:10.244094+0000","last_fullsized":"2023-10-06T03:55:10.244094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096240690000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.565981+0000","last_change":"2023-10-06T03:55:22.565888+0000","last_active":"2023-10-06T03:55:22.565981+0000","last_peered":"2023-10-06T03:55:22.565981+0000","last_clean":"2023-10-06T03:55:22.565981+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:55:22.565981+0000","last_undegraded":"2023-10-06T03:55:22.565981+0000","last_fullsized":"2023-10-06T03:55:22.565981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.565609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:55.230411+0000","scrub_duration":0.0038460399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'52","reported_seq":85,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.243466+0000","last_change":"2023-10-06T03:55:00.783365+0000","last_active":"2023-10-06T03:55:10.243466+0000","last_peered":"2023-10-06T03:55:10.243466+0000","last_clean":"2023-10-06T03:55:10.243466+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:55:10.243466+0000","last_undegraded":"2023-10-06T03:55:10.243466+0000","last_fullsized":"2023-10-06T03:55:10.243466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010425553000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.625168+0000","last_change":"2023-10-06T03:55:26.625028+0000","last_active":"2023-10-06T03:55:26.625168+0000","last_peered":"2023-10-06T03:55:26.625168+0000","last_clean":"2023-10-06T03:55:26.625168+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:55:26.625168+0000","last_undegraded":"2023-10-06T03:55:26.625168+0000","last_fullsized":"2023-10-06T03:55:26.625168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.624756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:01.989410+0000","scrub_duration":0.0039742479999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179026+0000","last_change":"2023-10-06T03:55:04.752729+0000","last_active":"2023-10-06T03:55:10.179026+0000","last_peered":"2023-10-06T03:55:10.179026+0000","last_clean":"2023-10-06T03:55:10.179026+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:55:10.179026+0000","last_undegraded":"2023-10-06T03:55:10.179026+0000","last_fullsized":"2023-10-06T03:55:10.179026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.752482+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.597358+0000","scrub_duration":0.0040964770000000003,"objects_trimmed":0,"snaptrim_duration":0.0068794099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.470473+0000","last_change":"2023-10-06T03:55:07.470370+0000","last_active":"2023-10-06T03:55:07.470473+0000","last_peered":"2023-10-06T03:55:07.470473+0000","last_clean":"2023-10-06T03:55:07.470473+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:55:07.470473+0000","last_undegraded":"2023-10-06T03:55:07.470473+0000","last_fullsized":"2023-10-06T03:55:07.470473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.470104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:04.916392+0000","scrub_duration":0.0045462330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'33","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.181021+0000","last_change":"2023-10-06T03:55:00.656022+0000","last_active":"2023-10-06T03:55:10.181021+0000","last_peered":"2023-10-06T03:55:10.181021+0000","last_clean":"2023-10-06T03:55:10.181021+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:55:10.181021+0000","last_undegraded":"2023-10-06T03:55:10.181021+0000","last_fullsized":"2023-10-06T03:55:10.181021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017320401999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:21.308283+0000","last_change":"2023-10-06T03:55:21.308191+0000","last_active":"2023-10-06T03:55:21.308283+0000","last_peered":"2023-10-06T03:55:21.308283+0000","last_clean":"2023-10-06T03:55:21.308283+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:55:21.308283+0000","last_undegraded":"2023-10-06T03:55:21.308283+0000","last_fullsized":"2023-10-06T03:55:21.308283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_clean_scrub_stamp":"2023-10-06T03:55:21.307933+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:15.544267+0000","scrub_duration":0.0067126479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'34","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180143+0000","last_change":"2023-10-06T03:55:00.655150+0000","last_active":"2023-10-06T03:55:10.180143+0000","last_peered":"2023-10-06T03:55:10.180143+0000","last_clean":"2023-10-06T03:55:10.180143+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:55:10.180143+0000","last_undegraded":"2023-10-06T03:55:10.180143+0000","last_fullsized":"2023-10-06T03:55:10.180143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017171387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:14.354640+0000","last_change":"2023-10-06T03:55:14.354561+0000","last_active":"2023-10-06T03:55:14.354640+0000","last_peered":"2023-10-06T03:55:14.354640+0000","last_clean":"2023-10-06T03:55:14.354640+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:55:14.354640+0000","last_undegraded":"2023-10-06T03:55:14.354640+0000","last_fullsized":"2023-10-06T03:55:14.354640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_clean_scrub_stamp":"2023-10-06T03:55:14.354279+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:59.917325+0000","scrub_duration":0.0068327010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.013042+0000","last_change":"2023-10-06T03:55:33.012971+0000","last_active":"2023-10-06T03:55:33.013042+0000","last_peered":"2023-10-06T03:55:33.013042+0000","last_clean":"2023-10-06T03:55:33.013042+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:55:33.013042+0000","last_undegraded":"2023-10-06T03:55:33.013042+0000","last_fullsized":"2023-10-06T03:55:33.013042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.012697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.306437+0000","scrub_duration":0.0037924479999999999,"objects_trimmed":0,"snaptrim_duration":0.0097448389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.905423+0000","last_change":"2023-10-06T03:55:24.905342+0000","last_active":"2023-10-06T03:55:24.905423+0000","last_peered":"2023-10-06T03:55:24.905423+0000","last_clean":"2023-10-06T03:55:24.905423+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:55:24.905423+0000","last_undegraded":"2023-10-06T03:55:24.905423+0000","last_fullsized":"2023-10-06T03:55:24.905423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.905072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:31.822314+0000","scrub_duration":0.0040591780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'33","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.659154+0000","last_change":"2023-10-06T03:55:33.659075+0000","last_active":"2023-10-06T03:55:33.659154+0000","last_peered":"2023-10-06T03:55:33.659154+0000","last_clean":"2023-10-06T03:55:33.659154+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:55:33.659154+0000","last_undegraded":"2023-10-06T03:55:33.659154+0000","last_fullsized":"2023-10-06T03:55:33.659154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.658825+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:58.914714+0000","scrub_duration":0.0039457449999999996,"objects_trimmed":0,"snaptrim_duration":0.016574254,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.469797+0000","last_change":"2023-10-06T03:55:28.469737+0000","last_active":"2023-10-06T03:55:28.469797+0000","last_peered":"2023-10-06T03:55:28.469797+0000","last_clean":"2023-10-06T03:55:28.469797+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:55:28.469797+0000","last_undegraded":"2023-10-06T03:55:28.469797+0000","last_fullsized":"2023-10-06T03:55:28.469797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.469538+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:15.418477+0000","scrub_duration":0.0089670759999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":479912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":207,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":959824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":1193661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.60499999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.173,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.208,"15min":1.208},"last":1.0509999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.113,"15min":1.03},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":15.292999999999999,"5min":15.292999999999999,"15min":15.292999999999999},"last":1.097},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.149,"15min":1.071},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":14.829000000000001,"5min":14.829000000000001,"15min":14.829000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.71399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.206,"5min":1.714,"15min":1.714},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0209999999999999},"min":{"1min":0.66800000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2949999999999999,"5min":1.649,"15min":1.649},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96099999999999997,"15min":0.94999999999999996},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.194,"15min":1.1879999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":1.2090000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.153},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0840000000000001,"15min":1.0880000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2490000000000001,"15min":1.2330000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":6.3209999999999997,"5min":6.3209999999999997,"15min":6.3209999999999997},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.782,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.29,"15min":1.319},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4470000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.234},{"interface":"front","average":{"1min":1.157,"5min":1.2490000000000001,"15min":1.2649999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.129}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3280000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.81499999999999995,"15min":0.79500000000000004},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2669999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.85999999999999999,"15min":0.84599999999999997},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.385,"15min":1.385},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93200000000000005,"15min":0.93000000000000005},"min":{"1min":0.67500000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1759999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.99099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.288,"5min":1.742,"15min":1.742},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2829999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.72599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.113},{"interface":"front","average":{"1min":1.056,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.80800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2110000000000001,"5min":1.53,"15min":1.53},"last":1.218}]},{"osd":4,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0649999999999999,"15min":1.075},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.306,"5min":1.379,"15min":1.379},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.087,"15min":1.0860000000000001},"min":{"1min":0.81100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.244}]},{"osd":5,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.077},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.165},{"interface":"front","average":{"1min":1.2,"5min":1.236,"15min":1.242},"min":{"1min":1.048,"5min":1.024,"15min":1.024},"max":{"1min":1.3959999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1879999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1990000000000001,"15min":1.2070000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.591,"5min":1.98,"15min":1.98},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1719999999999999,"15min":1.179},"min":{"1min":0.91100000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.339,"5min":1.661,"15min":1.661},"last":1.0669999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070132,"statfs":{"total":96636764160,"available":96327815168,"internally_reserved":0,"allocated":331776,"data_stored":130114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.68899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.151,"5min":1.224,"15min":1.224},"last":1.121},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.403,"15min":1.403},"last":1.048}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.181,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79500000000000004,"15min":0.77700000000000002},"min":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":1.0189999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89200000000000002,"15min":0.90100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.115,"5min":1.292,"15min":1.292},"last":1.073}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.69299999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.1060000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.234,"5min":1.724,"15min":1.724},"last":1.258}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.258,"5min":1.302,"15min":1.302},"last":1.284},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.137,"15min":1.155},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.256,"5min":1.536,"15min":1.536},"last":0.92200000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.089,"15min":1.097},"min":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.2909999999999999,"5min":1.355,"15min":1.355},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.306,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.232}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.3680000000000001,"5min":1.458,"15min":1.458},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.333,"5min":1.841,"15min":1.841},"last":1.3100000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":608688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.55500000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1579999999999999,"5min":1.234,"15min":1.234},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98799999999999999,"15min":0.99299999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.319,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.038}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.88200000000000001,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.389,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.97699999999999998,"15min":0.96099999999999997},"min":{"1min":0.80500000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.996}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.64300000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.288,"5min":1.726,"15min":1.726},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.012,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.202,"5min":1.611,"15min":1.611},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3540000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.103,"15min":1.129},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4019999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.198,"15min":1.21},"min":{"1min":0.89600000000000002,"5min":0.87,"15min":0.87},"max":{"1min":1.3169999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.069}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.877,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.409,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.014},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.4950000000000001,"5min":2.117,"15min":2.117},"last":0.97199999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":327680,"data_stored":129580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.81299999999999994}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98399999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68100000000000005,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0980000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.64700000000000002,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.75,"15min":0.73199999999999998},"min":{"1min":0.59099999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.125,"5min":1.323,"15min":1.323},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.88600000000000001,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2390000000000001,"5min":1.272,"15min":1.272},"last":1.236},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3340000000000001,"5min":1.452,"15min":1.452},"last":0.97799999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.77700000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3480000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.032},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3620000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.0109999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4139999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.64800000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.504,"15min":1.504},"last":1.1120000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0329999999999999,"15min":1.024},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.395,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.335},{"interface":"front","average":{"1min":1.125,"5min":1.097,"15min":1.093},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.462,"5min":1.788,"15min":1.788},"last":1.276}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.47999999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98999999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1739999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0289999999999999,"5min":1.216,"15min":1.216},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0649999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.03},"min":{"1min":0.85699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.276,"5min":1.385,"15min":1.385},"last":1.034}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.73199999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3400000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.254,"5min":1.54,"15min":1.54},"last":1.194}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.163,"15min":1.1619999999999999},"min":{"1min":0.79400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4710000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.121},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.88600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4870000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.2929999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.80900000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.476,"5min":1.506,"15min":1.506},"last":1.258},{"interface":"front","average":{"1min":1.131,"5min":1.1539999999999999,"15min":1.1579999999999999},"min":{"1min":0.755,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.53,"5min":1.798,"15min":1.798},"last":1.2330000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94499999999999995,"5min":1.337,"15min":1.337},"last":0.499},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.75},"min":{"1min":0.60099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2150000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.90600000000000003,"5min":1.54,"15min":1.54},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0940000000000001,"5min":1.224,"15min":1.224},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.97999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.004,"5min":1.28,"15min":1.28},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.77900000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3120000000000001,"5min":2.456,"15min":2.456},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.046,"5min":1.163,"15min":1.1830000000000001},"min":{"1min":0.81799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3280000000000001,"5min":1.78,"15min":1.78},"last":1.089}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.125,"15min":1.153},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.397,"5min":1.875,"15min":1.875},"last":1.161},{"interface":"front","average":{"1min":1.149,"5min":1.1950000000000001,"15min":1.2030000000000001},"min":{"1min":0.80200000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.732,"5min":1.946,"15min":1.946},"last":1.069}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.214,"15min":1.234},"min":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":2.532,"15min":2.532},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.103,"5min":1.1819999999999999,"15min":1.1950000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4570000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.24}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.667,"5min":2.044,"15min":2.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1990000000000001,"15min":1.2090000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.0269999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":929792,"data_stored":725967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1599999999999999,"5min":1.466,"15min":1.466},"last":0.746}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.81799999999999995,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.385,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85999999999999999,"15min":0.84399999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.036}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.097,"15min":1.107},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.353,"5min":1.595,"15min":1.595},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72199999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.8049999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.0070000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.5149999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.774,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.163},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0449999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.2}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.206,"15min":1.2110000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5740000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.01},{"interface":"front","average":{"1min":1.155,"5min":1.167,"15min":1.169},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7290000000000001,"5min":2.472,"15min":2.472},"last":1.2310000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":479198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":473803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:55:45.926 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.926 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.927 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.928 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-06T03:53:42.610498+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=42, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.929 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.929 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.929 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.929 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.930 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.930 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.930 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.930 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.930 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.931 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.931 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.931 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:55:45.931 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:56:03.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:03.195 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:05.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:56:06.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 Processor -- start 2023-10-06T03:56:06.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 -- start start 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e9813f000 0x7f3e980a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9813fca0 con 0x7f3e98142d20 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980a8110 con 0x7f3e980b0560 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9e553700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980aea80 con 0x7f3e9813f000 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e977fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3e98142d20 0x7f3e980a74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36446/0 (socket says 172.21.15.57:36446) 2023-10-06T03:56:06.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e977fe700 1 -- 172.21.15.57:0/3181865691 learned_addr learned my addr 172.21.15.57:0/3181865691 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9caf0700 1 --2- 172.21.15.57:0/3181865691 >> v2:172.21.15.105:3300/0 conn(0x7f3e9813f000 0x7f3e980a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665663954 0 0) 0x7f3e9813fca0 con 0x7f3e98142d20 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e80003570 con 0x7f3e98142d20 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854083517 0 0) 0x7f3e980a8110 con 0x7f3e980b0560 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e9813fca0 con 0x7f3e980b0560 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036450894 0 0) 0x7f3e80003570 con 0x7f3e98142d20 2023-10-06T03:56:06.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9caf0700 1 -- 172.21.15.57:0/3181865691 >> v1:172.21.15.105:6789/0 conn(0x7f3e980b0560 legacy=0x7f3e98142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9caf0700 1 -- 172.21.15.57:0/3181865691 >> v1:172.21.15.57:6789/0 conn(0x7f3e98142d20 legacy=0x7f3e980a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.042+0000 7f3e9caf0700 1 -- 172.21.15.57:0/3181865691 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9813f650 con 0x7f3e9813f000 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9caf0700 1 --2- 172.21.15.57:0/3181865691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e980a7bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009e60 tx=0x7f3e90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c1b969e5e0e5c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000e070 con 0x7f3e9813f000 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9000b7a0 con 0x7f3e9813f000 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e96ffd700 1 -- 172.21.15.57:0/3181865691 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88001470 con 0x7f3e9813f000 2023-10-06T03:56:06.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- 172.21.15.57:0/3181865691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 msgr2=0x7f3e980a7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 --2- 172.21.15.57:0/3181865691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e980a7bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009e60 tx=0x7f3e90009780 comp rx=0 tx=0).stop 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- 172.21.15.57:0/3181865691 shutdown_connections 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 --2- 172.21.15.57:0/3181865691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e980a7bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- 172.21.15.57:0/3181865691 >> 172.21.15.57:0/3181865691 conn(0x7f3e98067070 msgr2=0x7f3e98067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- 172.21.15.57:0/3181865691 shutdown_connections 2023-10-06T03:56:06.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- 172.21.15.57:0/3181865691 wait complete. 2023-10-06T03:56:06.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 Processor -- start 2023-10-06T03:56:06.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.046+0000 7f3e9e553700 1 -- start start 2023-10-06T03:56:06.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:06.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e9814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e98142d20 0x7f3e98138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9806e710 con 0x7f3e980b0560 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9806e940 con 0x7f3e9813f000 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b3080 con 0x7f3e98142d20 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9caf0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e98142d20 0x7f3e98138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37282/0 (socket says 172.21.15.57:37282) 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 -- 172.21.15.57:0/2304945353 learned_addr learned my addr 172.21.15.57:0/2304945353 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e977fe700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e9814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 -- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e98142d20 msgr2=0x7f3e98138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e98142d20 0x7f3e98138a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 -- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 msgr2=0x7f3e9814f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e9814f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 -- 172.21.15.57:0/2304945353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009a20 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e97fff700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c580 tx=0x7f3e8c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c010510 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c010670 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980b3580 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c010a30 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9806e280 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.050+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9806eb40 con 0x7f3e980b0560 2023-10-06T03:56:06.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.054+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3e8c025430 con 0x7f3e980b0560 2023-10-06T03:56:06.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.054+0000 7f3e7ffff700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 0x7f3e84062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:06.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.054+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f3e8c07cfc0 con 0x7f3e980b0560 2023-10-06T03:56:06.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.054+0000 7f3e977fe700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 0x7f3e84062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:06.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.054+0000 7f3e977fe700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 0x7f3e84062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e98153c20 tx=0x7f3e88000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:06.066 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.062+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3e8c04d400 con 0x7f3e980b0560 2023-10-06T03:56:06.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.222+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e980b3240 con 0x7f3e84060550 2023-10-06T03:56:06.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.238+0000 7f3e7ffff700 1 -- 172.21.15.57:0/2304945353 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312836 (secure 0 0 0) 0x7f3e980b3240 con 0x7f3e84060550 2023-10-06T03:56:06.246 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:56:06.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 msgr2=0x7f3e84062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 0x7f3e84062a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e98153c20 tx=0x7f3e88000bc0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 msgr2=0x7f3e980a68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00c580 tx=0x7f3e8c007e10 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 shutdown_connections 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3e84060550 0x7f3e84062a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e98142d20 0x7f3e98138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e9813f000 0x7f3e9814f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 --2- 172.21.15.57:0/2304945353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e980b0560 0x7f3e980a68d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 >> 172.21.15.57:0/2304945353 conn(0x7f3e98067070 msgr2=0x7f3e9813d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:06.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 shutdown_connections 2023-10-06T03:56:06.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:06.242+0000 7f3e9e553700 1 -- 172.21.15.57:0/2304945353 wait complete. 2023-10-06T03:56:06.250 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:56:06.262 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-10-06T03:56:04.678141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070280,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":416,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2430,"ondisk_log_size":2430,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403472,"kb_used_data":4688,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571248,"statfs":{"total":773094113280,"available":770632957952,"internally_reserved":0,"allocated":4800512,"data_stored":3176480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004569"},"pg_stats":[{"pgid":"4.3f","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.744705+0000","last_change":"2023-10-06T03:55:12.744584+0000","last_active":"2023-10-06T03:55:12.744705+0000","last_peered":"2023-10-06T03:55:12.744705+0000","last_clean":"2023-10-06T03:55:12.744705+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:55:12.744705+0000","last_undegraded":"2023-10-06T03:55:12.744705+0000","last_fullsized":"2023-10-06T03:55:12.744705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.744297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:23.844802+0000","scrub_duration":0.003817993,"objects_trimmed":0,"snaptrim_duration":0.0072822820000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.308893+0000","last_change":"2023-10-06T03:55:33.308839+0000","last_active":"2023-10-06T03:55:33.308893+0000","last_peered":"2023-10-06T03:55:33.308893+0000","last_clean":"2023-10-06T03:55:33.308893+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:55:33.308893+0000","last_undegraded":"2023-10-06T03:55:33.308893+0000","last_fullsized":"2023-10-06T03:55:33.308893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.308622+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:40.078317+0000","scrub_duration":0.0047154930000000003,"objects_trimmed":0,"snaptrim_duration":0.0099787499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:47.767265+0000","last_change":"2023-10-06T03:55:47.767177+0000","last_active":"2023-10-06T03:55:47.767265+0000","last_peered":"2023-10-06T03:55:47.767265+0000","last_clean":"2023-10-06T03:55:47.767265+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:55:47.767265+0000","last_undegraded":"2023-10-06T03:55:47.767265+0000","last_fullsized":"2023-10-06T03:55:47.767265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:47.766883+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:47.766883+0000","last_clean_scrub_stamp":"2023-10-06T03:55:47.766883+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:18.592102+0000","scrub_duration":0.0040608129999999999,"objects_trimmed":0,"snaptrim_duration":0.016761273,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.333432+0000","last_change":"2023-10-06T03:55:36.333314+0000","last_active":"2023-10-06T03:55:36.333432+0000","last_peered":"2023-10-06T03:55:36.333432+0000","last_clean":"2023-10-06T03:55:36.333432+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:55:36.333432+0000","last_undegraded":"2023-10-06T03:55:36.333432+0000","last_fullsized":"2023-10-06T03:55:36.333432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.333033+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:43.250275+0000","scrub_duration":0.0043010030000000003,"objects_trimmed":0,"snaptrim_duration":0.0063584109999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:31.524244+0000","last_change":"2023-10-06T03:55:31.524167+0000","last_active":"2023-10-06T03:55:31.524244+0000","last_peered":"2023-10-06T03:55:31.524244+0000","last_clean":"2023-10-06T03:55:31.524244+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:55:31.524244+0000","last_undegraded":"2023-10-06T03:55:31.524244+0000","last_fullsized":"2023-10-06T03:55:31.524244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_clean_scrub_stamp":"2023-10-06T03:55:31.523839+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:39.553275+0000","scrub_duration":0.0040562519999999998,"objects_trimmed":0,"snaptrim_duration":0.010010550999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'23","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180101+0000","last_change":"2023-10-06T03:55:00.654853+0000","last_active":"2023-10-06T03:55:10.180101+0000","last_peered":"2023-10-06T03:55:10.180101+0000","last_clean":"2023-10-06T03:55:10.180101+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:55:10.180101+0000","last_undegraded":"2023-10-06T03:55:10.180101+0000","last_fullsized":"2023-10-06T03:55:10.180101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017107009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:58.686358+0000","last_change":"2023-10-06T03:55:58.686284+0000","last_active":"2023-10-06T03:55:58.686358+0000","last_peered":"2023-10-06T03:55:58.686358+0000","last_clean":"2023-10-06T03:55:58.686358+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:55:58.686358+0000","last_undegraded":"2023-10-06T03:55:58.686358+0000","last_fullsized":"2023-10-06T03:55:58.686358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2023-10-06T03:55:58.686012+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2023-10-06T03:55:58.686012+0000","last_clean_scrub_stamp":"2023-10-06T03:55:58.686012+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:42.583218+0000","scrub_duration":0.0042401080000000002,"objects_trimmed":0,"snaptrim_duration":0.0044403079999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.327041+0000","last_change":"2023-10-06T03:55:35.327007+0000","last_active":"2023-10-06T03:55:35.327041+0000","last_peered":"2023-10-06T03:55:35.327041+0000","last_clean":"2023-10-06T03:55:35.327041+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:55:35.327041+0000","last_undegraded":"2023-10-06T03:55:35.327041+0000","last_fullsized":"2023-10-06T03:55:35.327041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.326856+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:52.589771+0000","scrub_duration":0.0029891750000000002,"objects_trimmed":0,"snaptrim_duration":0.010671256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:49.411680+0000","last_change":"2023-10-06T03:55:49.411614+0000","last_active":"2023-10-06T03:55:49.411680+0000","last_peered":"2023-10-06T03:55:49.411680+0000","last_clean":"2023-10-06T03:55:49.411680+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:55:49.411680+0000","last_undegraded":"2023-10-06T03:55:49.411680+0000","last_fullsized":"2023-10-06T03:55:49.411680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:49.411294+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:49.411294+0000","last_clean_scrub_stamp":"2023-10-06T03:55:49.411294+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:57.196202+0000","scrub_duration":0.0039509840000000003,"objects_trimmed":0,"snaptrim_duration":0.0092769180000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'58","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.277410+0000","last_change":"2023-10-06T03:55:30.277342+0000","last_active":"2023-10-06T03:55:30.277410+0000","last_peered":"2023-10-06T03:55:30.277410+0000","last_clean":"2023-10-06T03:55:30.277410+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:55:30.277410+0000","last_undegraded":"2023-10-06T03:55:30.277410+0000","last_fullsized":"2023-10-06T03:55:30.277410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.277075+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:48.177630+0000","scrub_duration":0.0041351799999999996,"objects_trimmed":0,"snaptrim_duration":0.010557138000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.581076+0000","last_change":"2023-10-06T03:55:16.580993+0000","last_active":"2023-10-06T03:55:16.581076+0000","last_peered":"2023-10-06T03:55:16.581076+0000","last_clean":"2023-10-06T03:55:16.581076+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:55:16.581076+0000","last_undegraded":"2023-10-06T03:55:16.581076+0000","last_fullsized":"2023-10-06T03:55:16.581076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.580732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:29.697352+0000","scrub_duration":0.0043988070000000002,"objects_trimmed":0,"snaptrim_duration":0.017044597000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:18.844477+0000","last_change":"2023-10-06T03:55:18.844353+0000","last_active":"2023-10-06T03:55:18.844477+0000","last_peered":"2023-10-06T03:55:18.844477+0000","last_clean":"2023-10-06T03:55:18.844477+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:55:18.844477+0000","last_undegraded":"2023-10-06T03:55:18.844477+0000","last_fullsized":"2023-10-06T03:55:18.844477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_clean_scrub_stamp":"2023-10-06T03:55:18.844084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.508568+0000","scrub_duration":0.0043501169999999997,"objects_trimmed":0,"snaptrim_duration":0.0069042510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178061+0000","last_change":"2023-10-06T03:55:05.759217+0000","last_active":"2023-10-06T03:55:10.178061+0000","last_peered":"2023-10-06T03:55:10.178061+0000","last_clean":"2023-10-06T03:55:10.178061+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:55:10.178061+0000","last_undegraded":"2023-10-06T03:55:10.178061+0000","last_fullsized":"2023-10-06T03:55:10.178061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.759109+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.428927+0000","scrub_duration":0.010541894,"objects_trimmed":0,"snaptrim_duration":0.006884589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'36","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.305313+0000","last_change":"2023-10-06T03:55:24.305239+0000","last_active":"2023-10-06T03:55:24.305313+0000","last_peered":"2023-10-06T03:55:24.305313+0000","last_clean":"2023-10-06T03:55:24.305313+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:55:24.305313+0000","last_undegraded":"2023-10-06T03:55:24.305313+0000","last_fullsized":"2023-10-06T03:55:24.305313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.304974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:28.003511+0000","scrub_duration":0.0047502239999999999,"objects_trimmed":0,"snaptrim_duration":0.010166412,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'33","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:55.652839+0000","last_change":"2023-10-06T03:55:55.652766+0000","last_active":"2023-10-06T03:55:55.652839+0000","last_peered":"2023-10-06T03:55:55.652839+0000","last_clean":"2023-10-06T03:55:55.652839+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:55:55.652839+0000","last_undegraded":"2023-10-06T03:55:55.652839+0000","last_fullsized":"2023-10-06T03:55:55.652839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:55:55.652465+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:55:55.652465+0000","last_clean_scrub_stamp":"2023-10-06T03:55:55.652465+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:16.488434+0000","scrub_duration":0.0042783810000000004,"objects_trimmed":0,"snaptrim_duration":0.0042743499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'40","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:56.923535+0000","last_change":"2023-10-06T03:55:56.923445+0000","last_active":"2023-10-06T03:55:56.923535+0000","last_peered":"2023-10-06T03:55:56.923535+0000","last_clean":"2023-10-06T03:55:56.923535+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:55:56.923535+0000","last_undegraded":"2023-10-06T03:55:56.923535+0000","last_fullsized":"2023-10-06T03:55:56.923535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-10-06T03:55:56.923140+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-10-06T03:55:56.923140+0000","last_clean_scrub_stamp":"2023-10-06T03:55:56.923140+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:51.032699+0000","scrub_duration":0.0048123690000000004,"objects_trimmed":0,"snaptrim_duration":0.016525431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'32","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.536276+0000","last_change":"2023-10-06T03:55:36.536204+0000","last_active":"2023-10-06T03:55:36.536276+0000","last_peered":"2023-10-06T03:55:36.536276+0000","last_clean":"2023-10-06T03:55:36.536276+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:55:36.536276+0000","last_undegraded":"2023-10-06T03:55:36.536276+0000","last_fullsized":"2023-10-06T03:55:36.536276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.535946+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:01.791835+0000","scrub_duration":0.0039438490000000001,"objects_trimmed":0,"snaptrim_duration":0.0096482700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'49","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:45.741178+0000","last_change":"2023-10-06T03:55:45.741107+0000","last_active":"2023-10-06T03:55:45.741178+0000","last_peered":"2023-10-06T03:55:45.741178+0000","last_clean":"2023-10-06T03:55:45.741178+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:55:45.741178+0000","last_undegraded":"2023-10-06T03:55:45.741178+0000","last_fullsized":"2023-10-06T03:55:45.741178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-10-06T03:55:45.740858+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-10-06T03:55:45.740858+0000","last_clean_scrub_stamp":"2023-10-06T03:55:45.740858+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:29.638063+0000","scrub_duration":0.0042111919999999999,"objects_trimmed":0,"snaptrim_duration":0.017171402999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.756421+0000","last_change":"2023-10-06T03:55:10.756346+0000","last_active":"2023-10-06T03:55:10.756421+0000","last_peered":"2023-10-06T03:55:10.756421+0000","last_clean":"2023-10-06T03:55:10.756421+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:55:10.756421+0000","last_undegraded":"2023-10-06T03:55:10.756421+0000","last_fullsized":"2023-10-06T03:55:10.756421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_clean_scrub_stamp":"2023-10-06T03:55:10.756040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.124413+0000","scrub_duration":0.0040958310000000003,"objects_trimmed":0,"snaptrim_duration":0.0063946960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:51.891609+0000","last_change":"2023-10-06T03:55:51.891535+0000","last_active":"2023-10-06T03:55:51.891609+0000","last_peered":"2023-10-06T03:55:51.891609+0000","last_clean":"2023-10-06T03:55:51.891609+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:55:51.891609+0000","last_undegraded":"2023-10-06T03:55:51.891609+0000","last_fullsized":"2023-10-06T03:55:51.891609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:51.891248+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:51.891248+0000","last_clean_scrub_stamp":"2023-10-06T03:55:51.891248+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:45.151246+0000","scrub_duration":0.0037043689999999999,"objects_trimmed":0,"snaptrim_duration":0.017011842999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'44","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:57.660382+0000","last_change":"2023-10-06T03:55:57.660302+0000","last_active":"2023-10-06T03:55:57.660382+0000","last_peered":"2023-10-06T03:55:57.660382+0000","last_clean":"2023-10-06T03:55:57.660382+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:55:57.660382+0000","last_undegraded":"2023-10-06T03:55:57.660382+0000","last_fullsized":"2023-10-06T03:55:57.660382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-10-06T03:55:57.660019+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-10-06T03:55:57.660019+0000","last_clean_scrub_stamp":"2023-10-06T03:55:57.660019+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:05.444927+0000","scrub_duration":0.004553779,"objects_trimmed":0,"snaptrim_duration":0.0045883720000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.504426+0000","last_change":"2023-10-06T03:55:29.504313+0000","last_active":"2023-10-06T03:55:29.504426+0000","last_peered":"2023-10-06T03:55:29.504426+0000","last_clean":"2023-10-06T03:55:29.504426+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:55:29.504426+0000","last_undegraded":"2023-10-06T03:55:29.504426+0000","last_fullsized":"2023-10-06T03:55:29.504426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.503976+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:34.797716+0000","scrub_duration":0.0038718749999999999,"objects_trimmed":0,"snaptrim_duration":0.010470313,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:58.306026+0000","last_change":"2023-10-06T03:55:58.305921+0000","last_active":"2023-10-06T03:55:58.306026+0000","last_peered":"2023-10-06T03:55:58.306026+0000","last_clean":"2023-10-06T03:55:58.306026+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:55:58.306026+0000","last_undegraded":"2023-10-06T03:55:58.306026+0000","last_fullsized":"2023-10-06T03:55:58.306026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:58.305625+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:58.305625+0000","last_clean_scrub_stamp":"2023-10-06T03:55:58.305625+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:18.127208+0000","scrub_duration":0.0041100140000000004,"objects_trimmed":0,"snaptrim_duration":0.0092240970000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'31","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:44.789111+0000","last_change":"2023-10-06T03:55:44.789049+0000","last_active":"2023-10-06T03:55:44.789111+0000","last_peered":"2023-10-06T03:55:44.789111+0000","last_clean":"2023-10-06T03:55:44.789111+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:55:44.789111+0000","last_undegraded":"2023-10-06T03:55:44.789111+0000","last_fullsized":"2023-10-06T03:55:44.789111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-10-06T03:55:44.788803+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-10-06T03:55:44.788803+0000","last_clean_scrub_stamp":"2023-10-06T03:55:44.788803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:10.044692+0000","scrub_duration":0.0044584380000000003,"objects_trimmed":0,"snaptrim_duration":0.0042144280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:38.561913+0000","last_change":"2023-10-06T03:55:38.561838+0000","last_active":"2023-10-06T03:55:38.561913+0000","last_peered":"2023-10-06T03:55:38.561913+0000","last_clean":"2023-10-06T03:55:38.561913+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:55:38.561913+0000","last_undegraded":"2023-10-06T03:55:38.561913+0000","last_fullsized":"2023-10-06T03:55:38.561913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_clean_scrub_stamp":"2023-10-06T03:55:38.561562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.855302+0000","scrub_duration":0.0041220800000000002,"objects_trimmed":0,"snaptrim_duration":0.010852538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'53","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.631821+0000","last_change":"2023-10-06T03:55:29.631754+0000","last_active":"2023-10-06T03:55:29.631821+0000","last_peered":"2023-10-06T03:55:29.631821+0000","last_clean":"2023-10-06T03:55:29.631821+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:55:29.631821+0000","last_undegraded":"2023-10-06T03:55:29.631821+0000","last_fullsized":"2023-10-06T03:55:29.631821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.631489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:42.748108+0000","scrub_duration":0.0040588150000000003,"objects_trimmed":0,"snaptrim_duration":0.0096577650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.342874+0000","last_change":"2023-10-06T03:55:32.342809+0000","last_active":"2023-10-06T03:55:32.342874+0000","last_peered":"2023-10-06T03:55:32.342874+0000","last_clean":"2023-10-06T03:55:32.342874+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:55:32.342874+0000","last_undegraded":"2023-10-06T03:55:32.342874+0000","last_fullsized":"2023-10-06T03:55:32.342874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.342538+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:38.710724+0000","scrub_duration":0.0042552450000000004,"objects_trimmed":0,"snaptrim_duration":0.0097876560000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.597821+0000","last_change":"2023-10-06T03:55:33.597725+0000","last_active":"2023-10-06T03:55:33.597821+0000","last_peered":"2023-10-06T03:55:33.597821+0000","last_clean":"2023-10-06T03:55:33.597821+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:55:33.597821+0000","last_undegraded":"2023-10-06T03:55:33.597821+0000","last_fullsized":"2023-10-06T03:55:33.597821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.597471+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:23.977067+0000","scrub_duration":0.0041129490000000003,"objects_trimmed":0,"snaptrim_duration":0.010385257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.069301+0000","last_change":"2023-10-06T03:55:35.069234+0000","last_active":"2023-10-06T03:55:35.069301+0000","last_peered":"2023-10-06T03:55:35.069301+0000","last_clean":"2023-10-06T03:55:35.069301+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:55:35.069301+0000","last_undegraded":"2023-10-06T03:55:35.069301+0000","last_fullsized":"2023-10-06T03:55:35.069301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.068954+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:43.098390+0000","scrub_duration":0.0045654429999999998,"objects_trimmed":0,"snaptrim_duration":0.0091510959999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180518+0000","last_change":"2023-10-06T03:55:04.638303+0000","last_active":"2023-10-06T03:55:10.180518+0000","last_peered":"2023-10-06T03:55:10.180518+0000","last_clean":"2023-10-06T03:55:10.180518+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:55:10.180518+0000","last_undegraded":"2023-10-06T03:55:10.180518+0000","last_fullsized":"2023-10-06T03:55:10.180518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.638053+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:02.084340+0000","scrub_duration":0.0042471119999999999,"objects_trimmed":0,"snaptrim_duration":0.017042165000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'43","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:56.253261+0000","last_change":"2023-10-06T03:55:56.253194+0000","last_active":"2023-10-06T03:55:56.253261+0000","last_peered":"2023-10-06T03:55:56.253261+0000","last_clean":"2023-10-06T03:55:56.253261+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:55:56.253261+0000","last_undegraded":"2023-10-06T03:55:56.253261+0000","last_fullsized":"2023-10-06T03:55:56.253261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2023-10-06T03:55:56.252892+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2023-10-06T03:55:56.252892+0000","last_clean_scrub_stamp":"2023-10-06T03:55:56.252892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:27.078112+0000","scrub_duration":0.0039321,"objects_trimmed":0,"snaptrim_duration":0.010478619,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.362644+0000","last_change":"2023-10-06T03:55:35.362577+0000","last_active":"2023-10-06T03:55:35.362644+0000","last_peered":"2023-10-06T03:55:35.362644+0000","last_clean":"2023-10-06T03:55:35.362644+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:55:35.362644+0000","last_undegraded":"2023-10-06T03:55:35.362644+0000","last_fullsized":"2023-10-06T03:55:35.362644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.362319+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:48.478939+0000","scrub_duration":0.0041746999999999999,"objects_trimmed":0,"snaptrim_duration":0.007180461,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'44","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.058107+0000","last_change":"2023-10-06T03:55:40.058037+0000","last_active":"2023-10-06T03:55:40.058107+0000","last_peered":"2023-10-06T03:55:40.058107+0000","last_clean":"2023-10-06T03:55:40.058107+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:55:40.058107+0000","last_undegraded":"2023-10-06T03:55:40.058107+0000","last_fullsized":"2023-10-06T03:55:40.058107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.057731+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:05.313619+0000","scrub_duration":0.0036339419999999998,"objects_trimmed":0,"snaptrim_duration":0.010865144,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.586469+0000","last_change":"2023-10-06T03:55:25.586350+0000","last_active":"2023-10-06T03:55:25.586469+0000","last_peered":"2023-10-06T03:55:25.586469+0000","last_clean":"2023-10-06T03:55:25.586469+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:55:25.586469+0000","last_undegraded":"2023-10-06T03:55:25.586469+0000","last_fullsized":"2023-10-06T03:55:25.586469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.586087+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:38.702706+0000","scrub_duration":0.0086854250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.319007+0000","last_change":"2023-10-06T03:55:25.318947+0000","last_active":"2023-10-06T03:55:25.319007+0000","last_peered":"2023-10-06T03:55:25.319007+0000","last_clean":"2023-10-06T03:55:25.319007+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:55:25.319007+0000","last_undegraded":"2023-10-06T03:55:25.319007+0000","last_fullsized":"2023-10-06T03:55:25.319007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.318651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:51.036219+0000","scrub_duration":0.0041645750000000002,"objects_trimmed":0,"snaptrim_duration":0.0097426309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.509563+0000","last_change":"2023-10-06T03:55:12.509433+0000","last_active":"2023-10-06T03:55:12.509563+0000","last_peered":"2023-10-06T03:55:12.509563+0000","last_clean":"2023-10-06T03:55:12.509563+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:55:12.509563+0000","last_undegraded":"2023-10-06T03:55:12.509563+0000","last_fullsized":"2023-10-06T03:55:12.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.509162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:45.173964+0000","scrub_duration":0.004617454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.546069+0000","last_change":"2023-10-06T03:55:30.546003+0000","last_active":"2023-10-06T03:55:30.546069+0000","last_peered":"2023-10-06T03:55:30.546069+0000","last_clean":"2023-10-06T03:55:30.546069+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:55:30.546069+0000","last_undegraded":"2023-10-06T03:55:30.546069+0000","last_fullsized":"2023-10-06T03:55:30.546069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.545739+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.910393+0000","scrub_duration":0.0038579909999999999,"objects_trimmed":0,"snaptrim_duration":0.0097705469999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.612194+0000","last_change":"2023-10-06T03:55:19.612128+0000","last_active":"2023-10-06T03:55:19.612194+0000","last_peered":"2023-10-06T03:55:19.612194+0000","last_clean":"2023-10-06T03:55:19.612194+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:55:19.612194+0000","last_undegraded":"2023-10-06T03:55:19.612194+0000","last_fullsized":"2023-10-06T03:55:19.612194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.611867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:23.143979+0000","scrub_duration":0.0039385999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'38","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:51.178896+0000","last_change":"2023-10-06T03:55:51.178834+0000","last_active":"2023-10-06T03:55:51.178896+0000","last_peered":"2023-10-06T03:55:51.178896+0000","last_clean":"2023-10-06T03:55:51.178896+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:55:51.178896+0000","last_undegraded":"2023-10-06T03:55:51.178896+0000","last_fullsized":"2023-10-06T03:55:51.178896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-10-06T03:55:51.178580+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-10-06T03:55:51.178580+0000","last_clean_scrub_stamp":"2023-10-06T03:55:51.178580+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:12.014549+0000","scrub_duration":0.0041793009999999998,"objects_trimmed":0,"snaptrim_duration":0.01003823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"30'13","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:11.262927+0000","last_change":"2023-10-06T03:55:11.262836+0000","last_active":"2023-10-06T03:55:11.262927+0000","last_peered":"2023-10-06T03:55:11.262927+0000","last_clean":"2023-10-06T03:55:11.262927+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:55:11.262927+0000","last_undegraded":"2023-10-06T03:55:11.262927+0000","last_fullsized":"2023-10-06T03:55:11.262927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_clean_scrub_stamp":"2023-10-06T03:55:11.262564+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.630938+0000","scrub_duration":0.010133995999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:00.738776+0000","last_change":"2023-10-06T03:56:00.738709+0000","last_active":"2023-10-06T03:56:00.738776+0000","last_peered":"2023-10-06T03:56:00.738776+0000","last_clean":"2023-10-06T03:56:00.738776+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:56:00.738776+0000","last_undegraded":"2023-10-06T03:56:00.738776+0000","last_fullsized":"2023-10-06T03:56:00.738776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-10-06T03:56:00.738436+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-10-06T03:56:00.738436+0000","last_clean_scrub_stamp":"2023-10-06T03:56:00.738436+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:31.563655+0000","scrub_duration":0.0078768870000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.280506+0000","last_change":"2023-10-06T03:55:23.280427+0000","last_active":"2023-10-06T03:55:23.280506+0000","last_peered":"2023-10-06T03:55:23.280506+0000","last_clean":"2023-10-06T03:55:23.280506+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:55:23.280506+0000","last_undegraded":"2023-10-06T03:55:23.280506+0000","last_fullsized":"2023-10-06T03:55:23.280506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.280171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:28.862189+0000","scrub_duration":0.0036857880000000002,"objects_trimmed":0,"snaptrim_duration":0.010236192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.573120+0000","last_change":"2023-10-06T03:55:26.573033+0000","last_active":"2023-10-06T03:55:26.573120+0000","last_peered":"2023-10-06T03:55:26.573120+0000","last_clean":"2023-10-06T03:55:26.573120+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:55:26.573120+0000","last_undegraded":"2023-10-06T03:55:26.573120+0000","last_fullsized":"2023-10-06T03:55:26.573120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.572789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:33.490031+0000","scrub_duration":0.0067112960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'10","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:49.841050+0000","last_change":"2023-10-06T03:55:49.840979+0000","last_active":"2023-10-06T03:55:49.841050+0000","last_peered":"2023-10-06T03:55:49.841050+0000","last_clean":"2023-10-06T03:55:49.841050+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:55:49.841050+0000","last_undegraded":"2023-10-06T03:55:49.841050+0000","last_fullsized":"2023-10-06T03:55:49.841050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2023-10-06T03:55:49.840705+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2023-10-06T03:55:49.840705+0000","last_clean_scrub_stamp":"2023-10-06T03:55:49.840705+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:09.662288+0000","scrub_duration":0.0042542589999999998,"objects_trimmed":0,"snaptrim_duration":0.016897651999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.658046+0000","last_change":"2023-10-06T03:55:34.657973+0000","last_active":"2023-10-06T03:55:34.658046+0000","last_peered":"2023-10-06T03:55:34.658046+0000","last_clean":"2023-10-06T03:55:34.658046+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:55:34.658046+0000","last_undegraded":"2023-10-06T03:55:34.658046+0000","last_fullsized":"2023-10-06T03:55:34.658046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.657722+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:21.606660+0000","scrub_duration":0.0072249790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.365499+0000","last_change":"2023-10-06T03:55:28.365395+0000","last_active":"2023-10-06T03:55:28.365499+0000","last_peered":"2023-10-06T03:55:28.365499+0000","last_clean":"2023-10-06T03:55:28.365499+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:55:28.365499+0000","last_undegraded":"2023-10-06T03:55:28.365499+0000","last_fullsized":"2023-10-06T03:55:28.365499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.365138+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:01.029940+0000","scrub_duration":0.0043556419999999998,"objects_trimmed":0,"snaptrim_duration":0.0063459989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.380585+0000","last_change":"2023-10-06T03:55:06.380488+0000","last_active":"2023-10-06T03:55:06.380585+0000","last_peered":"2023-10-06T03:55:06.380585+0000","last_clean":"2023-10-06T03:55:06.380585+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:55:06.380585+0000","last_undegraded":"2023-10-06T03:55:06.380585+0000","last_fullsized":"2023-10-06T03:55:06.380585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.380239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:10.084652+0000","scrub_duration":0.0039703960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:54.466759+0000","last_change":"2023-10-06T03:55:54.466642+0000","last_active":"2023-10-06T03:55:54.466759+0000","last_peered":"2023-10-06T03:55:54.466759+0000","last_clean":"2023-10-06T03:55:54.466759+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:55:54.466759+0000","last_undegraded":"2023-10-06T03:55:54.466759+0000","last_fullsized":"2023-10-06T03:55:54.466759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:54.466203+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:54.466203+0000","last_clean_scrub_stamp":"2023-10-06T03:55:54.466203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:14.287786+0000","scrub_duration":0.004285334,"objects_trimmed":0,"snaptrim_duration":0.0091432119999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.703876+0000","last_change":"2023-10-06T03:55:16.703748+0000","last_active":"2023-10-06T03:55:16.703876+0000","last_peered":"2023-10-06T03:55:16.703876+0000","last_clean":"2023-10-06T03:55:16.703876+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:55:16.703876+0000","last_undegraded":"2023-10-06T03:55:16.703876+0000","last_fullsized":"2023-10-06T03:55:16.703876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.703443+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:49.368245+0000","scrub_duration":0.011084629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.656552+0000","last_change":"2023-10-06T03:55:40.656426+0000","last_active":"2023-10-06T03:55:40.656552+0000","last_peered":"2023-10-06T03:55:40.656552+0000","last_clean":"2023-10-06T03:55:40.656552+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:55:40.656552+0000","last_undegraded":"2023-10-06T03:55:40.656552+0000","last_fullsized":"2023-10-06T03:55:40.656552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.656149+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.110491+0000","scrub_duration":0.0040888000000000001,"objects_trimmed":0,"snaptrim_duration":0.017145036999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.301487+0000","last_change":"2023-10-06T03:55:13.301391+0000","last_active":"2023-10-06T03:55:13.301487+0000","last_peered":"2023-10-06T03:55:13.301487+0000","last_clean":"2023-10-06T03:55:13.301487+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:55:13.301487+0000","last_undegraded":"2023-10-06T03:55:13.301487+0000","last_fullsized":"2023-10-06T03:55:13.301487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.301122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:24.401627+0000","scrub_duration":0.0044995039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:42.737055+0000","last_change":"2023-10-06T03:55:42.736955+0000","last_active":"2023-10-06T03:55:42.737055+0000","last_peered":"2023-10-06T03:55:42.737055+0000","last_clean":"2023-10-06T03:55:42.737055+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:55:42.737055+0000","last_undegraded":"2023-10-06T03:55:42.737055+0000","last_fullsized":"2023-10-06T03:55:42.737055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:42.736691+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:42.736691+0000","last_clean_scrub_stamp":"2023-10-06T03:55:42.736691+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:03.572661+0000","scrub_duration":0.004662167,"objects_trimmed":0,"snaptrim_duration":0.017135524999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.634668+0000","last_change":"2023-10-06T03:55:20.634606+0000","last_active":"2023-10-06T03:55:20.634668+0000","last_peered":"2023-10-06T03:55:20.634668+0000","last_clean":"2023-10-06T03:55:20.634668+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:55:20.634668+0000","last_undegraded":"2023-10-06T03:55:20.634668+0000","last_fullsized":"2023-10-06T03:55:20.634668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.634345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:11.013941+0000","scrub_duration":0.0041101649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.629081+0000","last_change":"2023-10-06T03:55:35.628954+0000","last_active":"2023-10-06T03:55:35.629081+0000","last_peered":"2023-10-06T03:55:35.629081+0000","last_clean":"2023-10-06T03:55:35.629081+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:55:35.629081+0000","last_undegraded":"2023-10-06T03:55:35.629081+0000","last_fullsized":"2023-10-06T03:55:35.629081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.628683+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:14.448761+0000","scrub_duration":0.0037000319999999998,"objects_trimmed":0,"snaptrim_duration":0.017297254000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:08.771338+0000","last_change":"2023-10-06T03:55:08.771121+0000","last_active":"2023-10-06T03:55:08.771338+0000","last_peered":"2023-10-06T03:55:08.771338+0000","last_clean":"2023-10-06T03:55:08.771338+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:55:08.771338+0000","last_undegraded":"2023-10-06T03:55:08.771338+0000","last_fullsized":"2023-10-06T03:55:08.771338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_clean_scrub_stamp":"2023-10-06T03:55:08.770817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:34.435300+0000","scrub_duration":0.0040354609999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:37.545844+0000","last_change":"2023-10-06T03:55:37.545705+0000","last_active":"2023-10-06T03:55:37.545844+0000","last_peered":"2023-10-06T03:55:37.545844+0000","last_clean":"2023-10-06T03:55:37.545844+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:55:37.545844+0000","last_undegraded":"2023-10-06T03:55:37.545844+0000","last_fullsized":"2023-10-06T03:55:37.545844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_clean_scrub_stamp":"2023-10-06T03:55:37.545413+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:24.494352+0000","scrub_duration":0.0038541280000000001,"objects_trimmed":0,"snaptrim_duration":0.0099655790000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.640255+0000","last_change":"2023-10-06T03:55:07.640070+0000","last_active":"2023-10-06T03:55:07.640255+0000","last_peered":"2023-10-06T03:55:07.640255+0000","last_clean":"2023-10-06T03:55:07.640255+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:55:07.640255+0000","last_undegraded":"2023-10-06T03:55:07.640255+0000","last_fullsized":"2023-10-06T03:55:07.640255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.639807+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.740312+0000","scrub_duration":0.013574480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.382170+0000","last_change":"2023-10-06T03:55:05.381563+0000","last_active":"2023-10-06T03:55:05.382170+0000","last_peered":"2023-10-06T03:55:05.382170+0000","last_clean":"2023-10-06T03:55:05.382170+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:55:05.382170+0000","last_undegraded":"2023-10-06T03:55:05.382170+0000","last_fullsized":"2023-10-06T03:55:05.382170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.381223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:37.257218+0000","scrub_duration":0.0045535489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:27.887604+0000","last_change":"2023-10-06T03:55:27.887534+0000","last_active":"2023-10-06T03:55:27.887604+0000","last_peered":"2023-10-06T03:55:27.887604+0000","last_clean":"2023-10-06T03:55:27.887604+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:55:27.887604+0000","last_undegraded":"2023-10-06T03:55:27.887604+0000","last_fullsized":"2023-10-06T03:55:27.887604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_clean_scrub_stamp":"2023-10-06T03:55:27.887241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:18.266837+0000","scrub_duration":0.0040139879999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.267114+0000","last_change":"2023-10-06T03:55:19.266995+0000","last_active":"2023-10-06T03:55:19.267114+0000","last_peered":"2023-10-06T03:55:19.267114+0000","last_clean":"2023-10-06T03:55:19.267114+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:55:19.267114+0000","last_undegraded":"2023-10-06T03:55:19.267114+0000","last_fullsized":"2023-10-06T03:55:19.267114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.266595+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.931079+0000","scrub_duration":0.004022856,"objects_trimmed":0,"snaptrim_duration":0.006907687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.633309+0000","last_change":"2023-10-06T03:55:12.633170+0000","last_active":"2023-10-06T03:55:12.633309+0000","last_peered":"2023-10-06T03:55:12.633309+0000","last_clean":"2023-10-06T03:55:12.633309+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:55:12.633309+0000","last_undegraded":"2023-10-06T03:55:12.633309+0000","last_fullsized":"2023-10-06T03:55:12.633309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.632897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:38.297380+0000","scrub_duration":0.005677596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.486436+0000","last_change":"2023-10-06T03:55:19.486358+0000","last_active":"2023-10-06T03:55:19.486436+0000","last_peered":"2023-10-06T03:55:19.486436+0000","last_clean":"2023-10-06T03:55:19.486436+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:55:19.486436+0000","last_undegraded":"2023-10-06T03:55:19.486436+0000","last_fullsized":"2023-10-06T03:55:19.486436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.486077+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:32.602697+0000","scrub_duration":0.0050046780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:47.352672+0000","last_change":"2023-10-06T03:55:47.352555+0000","last_active":"2023-10-06T03:55:47.352672+0000","last_peered":"2023-10-06T03:55:47.352672+0000","last_clean":"2023-10-06T03:55:47.352672+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:55:47.352672+0000","last_undegraded":"2023-10-06T03:55:47.352672+0000","last_fullsized":"2023-10-06T03:55:47.352672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:47.352113+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:47.352113+0000","last_clean_scrub_stamp":"2023-10-06T03:55:47.352113+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:08.188082+0000","scrub_duration":0.0042301930000000001,"objects_trimmed":0,"snaptrim_duration":0.0095532519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.388616+0000","last_change":"2023-10-06T03:55:03.796402+0000","last_active":"2023-10-06T03:55:05.388616+0000","last_peered":"2023-10-06T03:55:05.388616+0000","last_clean":"2023-10-06T03:55:05.388616+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:55:05.388616+0000","last_undegraded":"2023-10-06T03:55:05.388616+0000","last_fullsized":"2023-10-06T03:55:05.388616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_clean_scrub_stamp":"2023-10-06T03:55:03.796132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:06.103535+0000","scrub_duration":0.0035169239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.496877+0000","last_change":"2023-10-06T03:55:13.496803+0000","last_active":"2023-10-06T03:55:13.496877+0000","last_peered":"2023-10-06T03:55:13.496877+0000","last_clean":"2023-10-06T03:55:13.496877+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:55:13.496877+0000","last_undegraded":"2023-10-06T03:55:13.496877+0000","last_fullsized":"2023-10-06T03:55:13.496877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.496501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:39.160985+0000","scrub_duration":0.0059863599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.606531+0000","last_change":"2023-10-06T03:55:30.606439+0000","last_active":"2023-10-06T03:55:30.606531+0000","last_peered":"2023-10-06T03:55:30.606531+0000","last_clean":"2023-10-06T03:55:30.606531+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:55:30.606531+0000","last_undegraded":"2023-10-06T03:55:30.606531+0000","last_fullsized":"2023-10-06T03:55:30.606531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.606178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:37.523420+0000","scrub_duration":0.0047520510000000002,"objects_trimmed":0,"snaptrim_duration":0.010907283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.381440+0000","last_change":"2023-10-06T03:55:04.330738+0000","last_active":"2023-10-06T03:55:05.381440+0000","last_peered":"2023-10-06T03:55:05.381440+0000","last_clean":"2023-10-06T03:55:05.381440+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:55:05.381440+0000","last_undegraded":"2023-10-06T03:55:05.381440+0000","last_fullsized":"2023-10-06T03:55:05.381440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.330335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.964328+0000","scrub_duration":0.004180291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.570701+0000","last_change":"2023-10-06T03:55:24.570637+0000","last_active":"2023-10-06T03:55:24.570701+0000","last_peered":"2023-10-06T03:55:24.570701+0000","last_clean":"2023-10-06T03:55:24.570701+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:55:24.570701+0000","last_undegraded":"2023-10-06T03:55:24.570701+0000","last_fullsized":"2023-10-06T03:55:24.570701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.570374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:11.519312+0000","scrub_duration":0.0037479179999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'35","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.349129+0000","last_change":"2023-10-06T03:55:39.349071+0000","last_active":"2023-10-06T03:55:39.349129+0000","last_peered":"2023-10-06T03:55:39.349129+0000","last_clean":"2023-10-06T03:55:39.349129+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:55:39.349129+0000","last_undegraded":"2023-10-06T03:55:39.349129+0000","last_fullsized":"2023-10-06T03:55:39.349129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.348847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:56.849541+0000","scrub_duration":0.0038212530000000001,"objects_trimmed":0,"snaptrim_duration":0.010188835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.293117+0000","last_change":"2023-10-06T03:55:12.293033+0000","last_active":"2023-10-06T03:55:12.293117+0000","last_peered":"2023-10-06T03:55:12.293117+0000","last_clean":"2023-10-06T03:55:12.293117+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:55:12.293117+0000","last_undegraded":"2023-10-06T03:55:12.293117+0000","last_fullsized":"2023-10-06T03:55:12.293117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.292753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:14.664468+0000","scrub_duration":0.004434566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.520693+0000","last_change":"2023-10-06T03:55:07.520556+0000","last_active":"2023-10-06T03:55:07.520693+0000","last_peered":"2023-10-06T03:55:07.520693+0000","last_clean":"2023-10-06T03:55:07.520693+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:55:07.520693+0000","last_undegraded":"2023-10-06T03:55:07.520693+0000","last_fullsized":"2023-10-06T03:55:07.520693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.520348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.620853+0000","scrub_duration":0.003511218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.548926+0000","last_change":"2023-10-06T03:55:39.548799+0000","last_active":"2023-10-06T03:55:39.548926+0000","last_peered":"2023-10-06T03:55:39.548926+0000","last_clean":"2023-10-06T03:55:39.548926+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:55:39.548926+0000","last_undegraded":"2023-10-06T03:55:39.548926+0000","last_fullsized":"2023-10-06T03:55:39.548926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.548474+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:14.913128+0000","scrub_duration":0.0044120610000000001,"objects_trimmed":0,"snaptrim_duration":0.010698005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.458936+0000","last_change":"2023-10-06T03:55:16.458859+0000","last_active":"2023-10-06T03:55:16.458936+0000","last_peered":"2023-10-06T03:55:16.458936+0000","last_clean":"2023-10-06T03:55:16.458936+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:55:16.458936+0000","last_undegraded":"2023-10-06T03:55:16.458936+0000","last_fullsized":"2023-10-06T03:55:16.458936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.458563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:13.904851+0000","scrub_duration":0.0042922999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.633759+0000","last_change":"2023-10-06T03:55:13.633679+0000","last_active":"2023-10-06T03:55:13.633759+0000","last_peered":"2023-10-06T03:55:13.633759+0000","last_clean":"2023-10-06T03:55:13.633759+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:55:13.633759+0000","last_undegraded":"2023-10-06T03:55:13.633759+0000","last_fullsized":"2023-10-06T03:55:13.633759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.633435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:11.079723+0000","scrub_duration":0.004040732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'25","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:52.474736+0000","last_change":"2023-10-06T03:55:52.474659+0000","last_active":"2023-10-06T03:55:52.474736+0000","last_peered":"2023-10-06T03:55:52.474736+0000","last_clean":"2023-10-06T03:55:52.474736+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:55:52.474736+0000","last_undegraded":"2023-10-06T03:55:52.474736+0000","last_fullsized":"2023-10-06T03:55:52.474736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2023-10-06T03:55:52.474383+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2023-10-06T03:55:52.474383+0000","last_clean_scrub_stamp":"2023-10-06T03:55:52.474383+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:23.299603+0000","scrub_duration":0.0042178220000000004,"objects_trimmed":0,"snaptrim_duration":0.0093781690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.860757+0000","last_change":"2023-10-06T03:55:23.860690+0000","last_active":"2023-10-06T03:55:23.860757+0000","last_peered":"2023-10-06T03:55:23.860757+0000","last_clean":"2023-10-06T03:55:23.860757+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:55:23.860757+0000","last_undegraded":"2023-10-06T03:55:23.860757+0000","last_fullsized":"2023-10-06T03:55:23.860757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.860446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:36.977065+0000","scrub_duration":0.0090851030000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.506143+0000","last_change":"2023-10-06T03:55:05.502487+0000","last_active":"2023-10-06T03:55:05.506143+0000","last_peered":"2023-10-06T03:55:05.506143+0000","last_clean":"2023-10-06T03:55:05.506143+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:55:05.506143+0000","last_undegraded":"2023-10-06T03:55:05.506143+0000","last_fullsized":"2023-10-06T03:55:05.506143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.502231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:32.870605+0000","scrub_duration":0.0037392129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'38","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.026350+0000","last_change":"2023-10-06T03:55:34.026278+0000","last_active":"2023-10-06T03:55:34.026350+0000","last_peered":"2023-10-06T03:55:34.026350+0000","last_clean":"2023-10-06T03:55:34.026350+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:55:34.026350+0000","last_undegraded":"2023-10-06T03:55:34.026350+0000","last_fullsized":"2023-10-06T03:55:34.026350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.026024+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:09.390678+0000","scrub_duration":0.0046214760000000002,"objects_trimmed":0,"snaptrim_duration":0.010244603,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'6","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.456074+0000","last_change":"2023-10-06T03:55:06.455929+0000","last_active":"2023-10-06T03:55:06.456074+0000","last_peered":"2023-10-06T03:55:06.456074+0000","last_clean":"2023-10-06T03:55:06.456074+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:55:06.456074+0000","last_undegraded":"2023-10-06T03:55:06.456074+0000","last_fullsized":"2023-10-06T03:55:06.456074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.455659+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:32.120143+0000","scrub_duration":0.0048712210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.162781+0000","last_change":"2023-10-06T03:55:06.162696+0000","last_active":"2023-10-06T03:55:06.162781+0000","last_peered":"2023-10-06T03:55:06.162781+0000","last_clean":"2023-10-06T03:55:06.162781+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:55:06.162781+0000","last_undegraded":"2023-10-06T03:55:06.162781+0000","last_fullsized":"2023-10-06T03:55:06.162781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.162407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.832225+0000","scrub_duration":0.0036688609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179756+0000","last_change":"2023-10-06T03:55:09.636062+0000","last_active":"2023-10-06T03:55:10.179756+0000","last_peered":"2023-10-06T03:55:10.179756+0000","last_clean":"2023-10-06T03:55:10.179756+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:55:10.179756+0000","last_undegraded":"2023-10-06T03:55:10.179756+0000","last_fullsized":"2023-10-06T03:55:10.179756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_clean_scrub_stamp":"2023-10-06T03:55:09.635780+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:42.300582+0000","scrub_duration":0.0040873719999999997,"objects_trimmed":0,"snaptrim_duration":0.017171291000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'61","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:17.596116+0000","last_change":"2023-10-06T03:55:17.596047+0000","last_active":"2023-10-06T03:55:17.596116+0000","last_peered":"2023-10-06T03:55:17.596116+0000","last_clean":"2023-10-06T03:55:17.596116+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:55:17.596116+0000","last_undegraded":"2023-10-06T03:55:17.596116+0000","last_fullsized":"2023-10-06T03:55:17.596116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_clean_scrub_stamp":"2023-10-06T03:55:17.595793+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:24.513035+0000","scrub_duration":0.0039416820000000002,"objects_trimmed":0,"snaptrim_duration":0.016769477000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'135","reported_seq":161,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.626677+0000","last_change":"2023-10-06T03:55:25.626637+0000","last_active":"2023-10-06T03:55:25.626677+0000","last_peered":"2023-10-06T03:55:25.626677+0000","last_clean":"2023-10-06T03:55:25.626677+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:55:25.626677+0000","last_undegraded":"2023-10-06T03:55:25.626677+0000","last_fullsized":"2023-10-06T03:55:25.626677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'135","last_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_deep_scrub":"30'135","last_deep_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.626485+0000","objects_scrubbed":4,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:30.920225+0000","scrub_duration":0.013822174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473587,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'36","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:46.516192+0000","last_change":"2023-10-06T03:55:46.516067+0000","last_active":"2023-10-06T03:55:46.516192+0000","last_peered":"2023-10-06T03:55:46.516192+0000","last_clean":"2023-10-06T03:55:46.516192+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:55:46.516192+0000","last_undegraded":"2023-10-06T03:55:46.516192+0000","last_fullsized":"2023-10-06T03:55:46.516192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-10-06T03:55:46.515759+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-10-06T03:55:46.515759+0000","last_clean_scrub_stamp":"2023-10-06T03:55:46.515759+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:11.771647+0000","scrub_duration":0.0041334450000000003,"objects_trimmed":0,"snaptrim_duration":0.010103025,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'16","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.730215+0000","last_change":"2023-10-06T03:55:39.730095+0000","last_active":"2023-10-06T03:55:39.730215+0000","last_peered":"2023-10-06T03:55:39.730215+0000","last_clean":"2023-10-06T03:55:39.730215+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:55:39.730215+0000","last_undegraded":"2023-10-06T03:55:39.730215+0000","last_fullsized":"2023-10-06T03:55:39.730215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.729838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:47.759273+0000","scrub_duration":0.0091261050000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.345078+0000","last_change":"2023-10-06T03:55:07.344971+0000","last_active":"2023-10-06T03:55:07.345078+0000","last_peered":"2023-10-06T03:55:07.345078+0000","last_clean":"2023-10-06T03:55:07.345078+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:55:07.345078+0000","last_undegraded":"2023-10-06T03:55:07.345078+0000","last_fullsized":"2023-10-06T03:55:07.345078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.344686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:31.239949+0000","scrub_duration":0.004290271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:54.242941+0000","last_change":"2023-10-06T03:55:54.242799+0000","last_active":"2023-10-06T03:55:54.242941+0000","last_peered":"2023-10-06T03:55:54.242941+0000","last_clean":"2023-10-06T03:55:54.242941+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:55:54.242941+0000","last_undegraded":"2023-10-06T03:55:54.242941+0000","last_fullsized":"2023-10-06T03:55:54.242941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:54.242518+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:54.242518+0000","last_clean_scrub_stamp":"2023-10-06T03:55:54.242518+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:38.139724+0000","scrub_duration":0.0044822819999999998,"objects_trimmed":0,"snaptrim_duration":0.010254809,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.461561+0000","last_change":"2023-10-06T03:55:20.461433+0000","last_active":"2023-10-06T03:55:20.461561+0000","last_peered":"2023-10-06T03:55:20.461561+0000","last_clean":"2023-10-06T03:55:20.461561+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:55:20.461561+0000","last_undegraded":"2023-10-06T03:55:20.461561+0000","last_fullsized":"2023-10-06T03:55:20.461561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.461129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:27.378371+0000","scrub_duration":0.0050521910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:00.210619+0000","last_change":"2023-10-06T03:56:00.210548+0000","last_active":"2023-10-06T03:56:00.210619+0000","last_peered":"2023-10-06T03:56:00.210619+0000","last_clean":"2023-10-06T03:56:00.210619+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:56:00.210619+0000","last_undegraded":"2023-10-06T03:56:00.210619+0000","last_fullsized":"2023-10-06T03:56:00.210619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:56:00.210252+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:56:00.210252+0000","last_clean_scrub_stamp":"2023-10-06T03:56:00.210252+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:53.470250+0000","scrub_duration":0.0038805200000000001,"objects_trimmed":0,"snaptrim_duration":0.010824848999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.316781+0000","last_change":"2023-10-06T03:55:22.316719+0000","last_active":"2023-10-06T03:55:22.316781+0000","last_peered":"2023-10-06T03:55:22.316781+0000","last_clean":"2023-10-06T03:55:22.316781+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:55:22.316781+0000","last_undegraded":"2023-10-06T03:55:22.316781+0000","last_fullsized":"2023-10-06T03:55:22.316781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.316458+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:19.762745+0000","scrub_duration":0.0038390270000000001,"objects_trimmed":0,"snaptrim_duration":0.0072167000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.023492+0000","last_change":"2023-10-06T03:55:32.023425+0000","last_active":"2023-10-06T03:55:32.023492+0000","last_peered":"2023-10-06T03:55:32.023492+0000","last_clean":"2023-10-06T03:55:32.023492+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:55:32.023492+0000","last_undegraded":"2023-10-06T03:55:32.023492+0000","last_fullsized":"2023-10-06T03:55:32.023492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.023106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:18.972045+0000","scrub_duration":0.0039914340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:50.385334+0000","last_change":"2023-10-06T03:55:50.385288+0000","last_active":"2023-10-06T03:55:50.385334+0000","last_peered":"2023-10-06T03:55:50.385334+0000","last_clean":"2023-10-06T03:55:50.385334+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:55:50.385334+0000","last_undegraded":"2023-10-06T03:55:50.385334+0000","last_fullsized":"2023-10-06T03:55:50.385334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2023-10-06T03:55:50.385136+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2023-10-06T03:55:50.385136+0000","last_clean_scrub_stamp":"2023-10-06T03:55:50.385136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:34.282342+0000","scrub_duration":0.003439274,"objects_trimmed":0,"snaptrim_duration":0.0096240690000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.565981+0000","last_change":"2023-10-06T03:55:22.565888+0000","last_active":"2023-10-06T03:55:22.565981+0000","last_peered":"2023-10-06T03:55:22.565981+0000","last_clean":"2023-10-06T03:55:22.565981+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:55:22.565981+0000","last_undegraded":"2023-10-06T03:55:22.565981+0000","last_fullsized":"2023-10-06T03:55:22.565981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.565609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:55.230411+0000","scrub_duration":0.0038460399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'52","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:53.231119+0000","last_change":"2023-10-06T03:55:53.231042+0000","last_active":"2023-10-06T03:55:53.231119+0000","last_peered":"2023-10-06T03:55:53.231119+0000","last_clean":"2023-10-06T03:55:53.231119+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:55:53.231119+0000","last_undegraded":"2023-10-06T03:55:53.231119+0000","last_fullsized":"2023-10-06T03:55:53.231119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-10-06T03:55:53.230784+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-10-06T03:55:53.230784+0000","last_clean_scrub_stamp":"2023-10-06T03:55:53.230784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:01.015692+0000","scrub_duration":0.0044376190000000003,"objects_trimmed":0,"snaptrim_duration":0.010425553000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.625168+0000","last_change":"2023-10-06T03:55:26.625028+0000","last_active":"2023-10-06T03:55:26.625168+0000","last_peered":"2023-10-06T03:55:26.625168+0000","last_clean":"2023-10-06T03:55:26.625168+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:55:26.625168+0000","last_undegraded":"2023-10-06T03:55:26.625168+0000","last_fullsized":"2023-10-06T03:55:26.625168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.624756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:01.989410+0000","scrub_duration":0.0039742479999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179026+0000","last_change":"2023-10-06T03:55:04.752729+0000","last_active":"2023-10-06T03:55:10.179026+0000","last_peered":"2023-10-06T03:55:10.179026+0000","last_clean":"2023-10-06T03:55:10.179026+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:55:10.179026+0000","last_undegraded":"2023-10-06T03:55:10.179026+0000","last_fullsized":"2023-10-06T03:55:10.179026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.752482+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.597358+0000","scrub_duration":0.0040964770000000003,"objects_trimmed":0,"snaptrim_duration":0.0068794099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.470473+0000","last_change":"2023-10-06T03:55:07.470370+0000","last_active":"2023-10-06T03:55:07.470473+0000","last_peered":"2023-10-06T03:55:07.470473+0000","last_clean":"2023-10-06T03:55:07.470473+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:55:07.470473+0000","last_undegraded":"2023-10-06T03:55:07.470473+0000","last_fullsized":"2023-10-06T03:55:07.470473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.470104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:04.916392+0000","scrub_duration":0.0045462330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'33","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:44.786254+0000","last_change":"2023-10-06T03:55:44.786254+0000","last_active":"2023-10-06T03:55:44.786254+0000","last_peered":"2023-10-06T03:55:44.786254+0000","last_clean":"2023-10-06T03:55:44.786254+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:55:44.786254+0000","last_undegraded":"2023-10-06T03:55:44.786254+0000","last_fullsized":"2023-10-06T03:55:44.786254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:53:43.615112+0000","last_clean_scrub_stamp":"2023-10-06T03:53:43.615112+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017320401999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:21.308283+0000","last_change":"2023-10-06T03:55:21.308191+0000","last_active":"2023-10-06T03:55:21.308283+0000","last_peered":"2023-10-06T03:55:21.308283+0000","last_clean":"2023-10-06T03:55:21.308283+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:55:21.308283+0000","last_undegraded":"2023-10-06T03:55:21.308283+0000","last_fullsized":"2023-10-06T03:55:21.308283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_clean_scrub_stamp":"2023-10-06T03:55:21.307933+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:15.544267+0000","scrub_duration":0.0067126479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:59.834167+0000","last_change":"2023-10-06T03:55:59.834052+0000","last_active":"2023-10-06T03:55:59.834167+0000","last_peered":"2023-10-06T03:55:59.834167+0000","last_clean":"2023-10-06T03:55:59.834167+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:55:59.834167+0000","last_undegraded":"2023-10-06T03:55:59.834167+0000","last_fullsized":"2023-10-06T03:55:59.834167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:59.833796+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:59.833796+0000","last_clean_scrub_stamp":"2023-10-06T03:55:59.833796+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:23.293561+0000","scrub_duration":0.0041365239999999999,"objects_trimmed":0,"snaptrim_duration":0.017171387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:14.354640+0000","last_change":"2023-10-06T03:55:14.354561+0000","last_active":"2023-10-06T03:55:14.354640+0000","last_peered":"2023-10-06T03:55:14.354640+0000","last_clean":"2023-10-06T03:55:14.354640+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:55:14.354640+0000","last_undegraded":"2023-10-06T03:55:14.354640+0000","last_fullsized":"2023-10-06T03:55:14.354640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_clean_scrub_stamp":"2023-10-06T03:55:14.354279+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:59.917325+0000","scrub_duration":0.0068327010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.013042+0000","last_change":"2023-10-06T03:55:33.012971+0000","last_active":"2023-10-06T03:55:33.013042+0000","last_peered":"2023-10-06T03:55:33.013042+0000","last_clean":"2023-10-06T03:55:33.013042+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:55:33.013042+0000","last_undegraded":"2023-10-06T03:55:33.013042+0000","last_fullsized":"2023-10-06T03:55:33.013042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.012697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.306437+0000","scrub_duration":0.0037924479999999999,"objects_trimmed":0,"snaptrim_duration":0.0097448389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.905423+0000","last_change":"2023-10-06T03:55:24.905342+0000","last_active":"2023-10-06T03:55:24.905423+0000","last_peered":"2023-10-06T03:55:24.905423+0000","last_clean":"2023-10-06T03:55:24.905423+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:55:24.905423+0000","last_undegraded":"2023-10-06T03:55:24.905423+0000","last_fullsized":"2023-10-06T03:55:24.905423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.905072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:31.822314+0000","scrub_duration":0.0040591780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'33","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.659154+0000","last_change":"2023-10-06T03:55:33.659075+0000","last_active":"2023-10-06T03:55:33.659154+0000","last_peered":"2023-10-06T03:55:33.659154+0000","last_clean":"2023-10-06T03:55:33.659154+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:55:33.659154+0000","last_undegraded":"2023-10-06T03:55:33.659154+0000","last_fullsized":"2023-10-06T03:55:33.659154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.658825+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:58.914714+0000","scrub_duration":0.0039457449999999996,"objects_trimmed":0,"snaptrim_duration":0.016574254,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.469797+0000","last_change":"2023-10-06T03:55:28.469737+0000","last_active":"2023-10-06T03:55:28.469797+0000","last_peered":"2023-10-06T03:55:28.469797+0000","last_clean":"2023-10-06T03:55:28.469797+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:55:28.469797+0000","last_undegraded":"2023-10-06T03:55:28.469797+0000","last_fullsized":"2023-10-06T03:55:28.469797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.469538+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:15.418477+0000","scrub_duration":0.0089670759999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":479912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":207,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":959824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":1193661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.60499999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.173,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.208,"15min":1.208},"last":0.94499999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.113,"15min":1.03},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":15.292999999999999,"5min":15.292999999999999,"15min":15.292999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.149,"15min":1.071},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":14.829000000000001,"5min":14.829000000000001,"15min":14.829000000000001},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.71399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.206,"5min":1.714,"15min":1.714},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0209999999999999},"min":{"1min":0.66800000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2949999999999999,"5min":1.649,"15min":1.649},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96099999999999997,"15min":0.94999999999999996},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.194,"15min":1.1879999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":1.042}]},{"osd":4,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.153},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0840000000000001,"15min":1.0880000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.105}]},{"osd":5,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2490000000000001,"15min":1.2330000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":6.3209999999999997,"5min":6.3209999999999997,"15min":6.3209999999999997},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.782,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.29,"15min":1.319},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4470000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.2490000000000001,"15min":1.2649999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.202}]}]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3280000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.81499999999999995,"15min":0.79500000000000004},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2669999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.98699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.85999999999999999,"15min":0.84599999999999997},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.385,"15min":1.385},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93200000000000005,"15min":0.93000000000000005},"min":{"1min":0.67500000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1759999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.0700000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.288,"5min":1.742,"15min":1.742},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2829999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.72599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.056,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.80800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2110000000000001,"5min":1.53,"15min":1.53},"last":0.92400000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0649999999999999,"15min":1.075},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.306,"5min":1.379,"15min":1.379},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.087,"15min":1.0860000000000001},"min":{"1min":0.81100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.077},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.2,"5min":1.236,"15min":1.242},"min":{"1min":1.048,"5min":1.024,"15min":1.024},"max":{"1min":1.3959999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1990000000000001,"15min":1.2070000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.591,"5min":1.98,"15min":1.98},"last":1.24},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1719999999999999,"15min":1.179},"min":{"1min":0.91100000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.339,"5min":1.661,"15min":1.661},"last":1.1160000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070132,"statfs":{"total":96636764160,"available":96327815168,"internally_reserved":0,"allocated":331776,"data_stored":130114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.68899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.151,"5min":1.224,"15min":1.224},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.403,"15min":1.403},"last":0.98699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.181,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79500000000000004,"15min":0.77700000000000002},"min":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89200000000000002,"15min":0.90100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.115,"5min":1.292,"15min":1.292},"last":0.94499999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.69299999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.1060000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.234,"5min":1.724,"15min":1.724},"last":1.097}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.258,"5min":1.302,"15min":1.302},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.137,"15min":1.155},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.256,"5min":1.536,"15min":1.536},"last":1.2230000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.089,"15min":1.097},"min":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.2909999999999999,"5min":1.355,"15min":1.355},"last":1.056},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.306,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.1919999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.3680000000000001,"5min":1.458,"15min":1.458},"last":1.075},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.333,"5min":1.841,"15min":1.841},"last":1.143}]}]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":608688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.55500000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1579999999999999,"5min":1.234,"15min":1.234},"last":0.82599999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98799999999999999,"15min":0.99299999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.319,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0609999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.88200000000000001,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.389,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.97699999999999998,"15min":0.96099999999999997},"min":{"1min":0.80500000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.171}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.64300000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.288,"5min":1.726,"15min":1.726},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.012,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.202,"5min":1.611,"15min":1.611},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3540000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.87}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.103,"15min":1.129},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4019999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.198,"15min":1.21},"min":{"1min":0.89600000000000002,"5min":0.87,"15min":0.87},"max":{"1min":1.3169999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.115}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.877,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.409,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.752},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.4950000000000001,"5min":2.117,"15min":2.117},"last":1.0209999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":327680,"data_stored":129580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98399999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68100000000000005,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0980000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.83499999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.64700000000000002,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.75,"15min":0.73199999999999998},"min":{"1min":0.59099999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.125,"5min":1.323,"15min":1.323},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.88600000000000001,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2390000000000001,"5min":1.272,"15min":1.272},"last":0.88},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3340000000000001,"5min":1.452,"15min":1.452},"last":0.93899999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.77700000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3480000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3620000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.038}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4139999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.073,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.64800000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.504,"15min":1.504},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0329999999999999,"15min":1.024},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.395,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.097,"15min":1.093},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.462,"5min":1.788,"15min":1.788},"last":1.1299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.47999999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98999999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1739999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0289999999999999,"5min":1.216,"15min":1.216},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.03},"min":{"1min":0.85699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.276,"5min":1.385,"15min":1.385},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.73199999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3400000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.254,"5min":1.54,"15min":1.54},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.163,"15min":1.1619999999999999},"min":{"1min":0.79400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4710000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.88600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4870000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.80900000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.476,"5min":1.506,"15min":1.506},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1539999999999999,"15min":1.1579999999999999},"min":{"1min":0.755,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.53,"5min":1.798,"15min":1.798},"last":1.127}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94499999999999995,"5min":1.337,"15min":1.337},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.75},"min":{"1min":0.60099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2150000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.90600000000000003,"5min":1.54,"15min":1.54},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0940000000000001,"5min":1.224,"15min":1.224},"last":1.069}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.97999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.004,"5min":1.28,"15min":1.28},"last":0.61499999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.77900000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3120000000000001,"5min":2.456,"15min":2.456},"last":1.006},{"interface":"front","average":{"1min":1.046,"5min":1.163,"15min":1.1830000000000001},"min":{"1min":0.81799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3280000000000001,"5min":1.78,"15min":1.78},"last":1.0349999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.125,"15min":1.153},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.397,"5min":1.875,"15min":1.875},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.149,"5min":1.1950000000000001,"15min":1.2030000000000001},"min":{"1min":0.80200000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.732,"5min":1.946,"15min":1.946},"last":1.169}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.214,"15min":1.234},"min":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":2.532,"15min":2.532},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.103,"5min":1.1819999999999999,"15min":1.1950000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4570000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.667,"5min":2.044,"15min":2.044},"last":1.121},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1990000000000001,"15min":1.2090000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.0900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":929792,"data_stored":725967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1599999999999999,"5min":1.466,"15min":1.466},"last":1.4650000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.81799999999999995,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.385,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.012},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":1.6839999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85999999999999999,"15min":0.84399999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":1.319}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.097,"15min":1.107},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.353,"5min":1.595,"15min":1.595},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72199999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.8049999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.0070000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.377},{"interface":"front","average":{"1min":1.111,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.5149999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.623}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.774,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0449999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.5800000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.206,"15min":1.2110000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5740000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.167,"15min":1.169},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7290000000000001,"5min":2.472,"15min":2.472},"last":1.2809999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":479198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":473803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:56:06.269 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:56:06.270 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-06T03:53:43.615112+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=53, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=54, tm_sec=59, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:56:06.271 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:56:26.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:56:26.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 Processor -- start 2023-10-06T03:56:26.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 -- start start 2023-10-06T03:56:26.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 0x7efeac1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efeac142a20 0x7efeac0af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efeac0afe40 0x7efeac0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0aeab0 con 0x7efeac0afe40 2023-10-06T03:56:26.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac06e280 con 0x7efeac142a20 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb1880700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0abdd0 con 0x7efeac0701c0 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efeac0afe40 0x7efeac0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efeac0afe40 0x7efeac0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32936/0 (socket says 172.21.15.57:32936) 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 -- 172.21.15.57:0/1009585280 learned_addr learned my addr 172.21.15.57:0/1009585280 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb087e700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 0x7efeac1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeabfff700 1 --2- 172.21.15.57:0/1009585280 >> v2:172.21.15.105:3300/0 conn(0x7efeac142a20 0x7efeac0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 -- 172.21.15.57:0/1009585280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 msgr2=0x7efeac1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 0x7efeac1424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 -- 172.21.15.57:0/1009585280 >> v2:172.21.15.105:3300/0 conn(0x7efeac142a20 msgr2=0x7efeac0af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 --2- 172.21.15.57:0/1009585280 >> v2:172.21.15.105:3300/0 conn(0x7efeac142a20 0x7efeac0af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 -- 172.21.15.57:0/1009585280 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac06e480 con 0x7efeac0afe40 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb087e700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 0x7efeac1424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:56:26.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeb107f700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0afe40 0x7efeac0b02c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efeac063510 tx=0x7efea4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b619278b82a5ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeab7fe700 1 -- 172.21.15.57:0/1009585280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400e070 con 0x7efeac0afe40 2023-10-06T03:56:26.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeab7fe700 1 -- 172.21.15.57:0/1009585280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400ba20 con 0x7efeac0afe40 2023-10-06T03:56:26.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.385+0000 7efeab7fe700 1 -- 172.21.15.57:0/1009585280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40092e0 con 0x7efeac0afe40 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- 172.21.15.57:0/1009585280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0afe40 msgr2=0x7efeac0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0afe40 0x7efeac0b02c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efeac063510 tx=0x7efea4009840 comp rx=0 tx=0).stop 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- 172.21.15.57:0/1009585280 shutdown_connections 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0afe40 0x7efeac0b02c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 --2- 172.21.15.57:0/1009585280 >> v2:172.21.15.105:3300/0 conn(0x7efeac142a20 0x7efeac0af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 --2- 172.21.15.57:0/1009585280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac0701c0 0x7efeac1424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- 172.21.15.57:0/1009585280 >> 172.21.15.57:0/1009585280 conn(0x7efeac0b1a00 msgr2=0x7efeac0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- 172.21.15.57:0/1009585280 shutdown_connections 2023-10-06T03:56:26.395 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- 172.21.15.57:0/1009585280 wait complete. 2023-10-06T03:56:26.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 Processor -- start 2023-10-06T03:56:26.396 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.389+0000 7efeb1880700 1 -- start start 2023-10-06T03:56:26.397 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0afe40 0x7efeac155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac142a20 0x7efeac067070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0a4c90 con 0x7efeac0701c0 2023-10-06T03:56:26.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0ab830 con 0x7efeac0afe40 2023-10-06T03:56:26.398 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0a4e90 con 0x7efeac142a20 2023-10-06T03:56:26.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeabfff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0afe40 0x7efeac155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32948/0 (socket says 172.21.15.57:32948) 2023-10-06T03:56:26.403 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 -- 172.21.15.57:0/3926074016 learned_addr learned my addr 172.21.15.57:0/3926074016 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb107f700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac142a20 0x7efeac067070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 -- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac142a20 msgr2=0x7efeac067070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac142a20 0x7efeac067070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 -- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0afe40 msgr2=0x7efeac155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0afe40 0x7efeac155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 -- 172.21.15.57:0/3926074016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009ae0 con 0x7efeac0701c0 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb087e700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efea000e900 tx=0x7efea0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0013410 con 0x7efeac0701c0 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea0013570 con 0x7efeac0701c0 2023-10-06T03:56:26.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac156060 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea0013910 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.393+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac155600 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac06b930 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7efea0013d00 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efea8ff9700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 0x7efe98062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7efea007c5d0 con 0x7efeac0701c0 2023-10-06T03:56:26.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efeabfff700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 0x7efe98062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.397+0000 7efeabfff700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 0x7efe98062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b62d0 tx=0x7efe9c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.405+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efea004c990 con 0x7efeac0701c0 2023-10-06T03:56:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.565+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 --> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efeac06d920 con 0x7efe98060550 2023-10-06T03:56:26.590 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.585+0000 7efea8ff9700 1 -- 172.21.15.57:0/3926074016 <== mgr.4102 v2:172.21.15.105:6832/33285 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312813 (secure 0 0 0) 0x7efeac06d920 con 0x7efe98060550 2023-10-06T03:56:26.594 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:56:26.596 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 msgr2=0x7efe98062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 0x7efe98062a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efeac0b62d0 tx=0x7efe9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 msgr2=0x7efeac0ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efea000e900 tx=0x7efea0008040 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 shutdown_connections 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7efe98060550 0x7efe98062a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efeac142a20 0x7efeac067070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeac0afe40 0x7efeac155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 --2- 172.21.15.57:0/3926074016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0701c0 0x7efeac0ab1c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 >> 172.21.15.57:0/3926074016 conn(0x7efeac0b1a00 msgr2=0x7efeac143520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 shutdown_connections 2023-10-06T03:56:26.597 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.589+0000 7efeb1880700 1 -- 172.21.15.57:0/3926074016 wait complete. 2023-10-06T03:56:26.598 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2023-10-06T03:56:26.610 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-10-06T03:56:24.685136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070280,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":416,"num_write_kb":3018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2430,"ondisk_log_size":2430,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403472,"kb_used_data":4688,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752571248,"statfs":{"total":773094113280,"available":770632957952,"internally_reserved":0,"allocated":4800512,"data_stored":3176480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004506"},"pg_stats":[{"pgid":"4.3f","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.744705+0000","last_change":"2023-10-06T03:55:12.744584+0000","last_active":"2023-10-06T03:55:12.744705+0000","last_peered":"2023-10-06T03:55:12.744705+0000","last_clean":"2023-10-06T03:55:12.744705+0000","last_became_active":"2023-10-06T03:53:44.661900+0000","last_became_peered":"2023-10-06T03:53:44.661900+0000","last_unstale":"2023-10-06T03:55:12.744705+0000","last_undegraded":"2023-10-06T03:55:12.744705+0000","last_fullsized":"2023-10-06T03:55:12.744705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:12.744297+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.744297+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:23.844802+0000","scrub_duration":0.003817993,"objects_trimmed":0,"snaptrim_duration":0.0072822820000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"27'18","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.308893+0000","last_change":"2023-10-06T03:55:33.308839+0000","last_active":"2023-10-06T03:55:33.308893+0000","last_peered":"2023-10-06T03:55:33.308893+0000","last_clean":"2023-10-06T03:55:33.308893+0000","last_became_active":"2023-10-06T03:53:44.665309+0000","last_became_peered":"2023-10-06T03:53:44.665309+0000","last_unstale":"2023-10-06T03:55:33.308893+0000","last_undegraded":"2023-10-06T03:55:33.308893+0000","last_fullsized":"2023-10-06T03:55:33.308893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2023-10-06T03:55:33.308622+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.308622+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:40.078317+0000","scrub_duration":0.0047154930000000003,"objects_trimmed":0,"snaptrim_duration":0.0099787499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:47.767265+0000","last_change":"2023-10-06T03:55:47.767177+0000","last_active":"2023-10-06T03:55:47.767265+0000","last_peered":"2023-10-06T03:55:47.767265+0000","last_clean":"2023-10-06T03:55:47.767265+0000","last_became_active":"2023-10-06T03:53:44.662881+0000","last_became_peered":"2023-10-06T03:53:44.662881+0000","last_unstale":"2023-10-06T03:55:47.767265+0000","last_undegraded":"2023-10-06T03:55:47.767265+0000","last_fullsized":"2023-10-06T03:55:47.767265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:47.766883+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:47.766883+0000","last_clean_scrub_stamp":"2023-10-06T03:55:47.766883+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:18.592102+0000","scrub_duration":0.0040608129999999999,"objects_trimmed":0,"snaptrim_duration":0.016761273,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.333432+0000","last_change":"2023-10-06T03:55:36.333314+0000","last_active":"2023-10-06T03:55:36.333432+0000","last_peered":"2023-10-06T03:55:36.333432+0000","last_clean":"2023-10-06T03:55:36.333432+0000","last_became_active":"2023-10-06T03:53:44.661811+0000","last_became_peered":"2023-10-06T03:53:44.661811+0000","last_unstale":"2023-10-06T03:55:36.333432+0000","last_undegraded":"2023-10-06T03:55:36.333432+0000","last_fullsized":"2023-10-06T03:55:36.333432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:36.333033+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.333033+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:43.250275+0000","scrub_duration":0.0043010030000000003,"objects_trimmed":0,"snaptrim_duration":0.0063584109999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:31.524244+0000","last_change":"2023-10-06T03:55:31.524167+0000","last_active":"2023-10-06T03:55:31.524244+0000","last_peered":"2023-10-06T03:55:31.524244+0000","last_clean":"2023-10-06T03:55:31.524244+0000","last_became_active":"2023-10-06T03:53:44.657890+0000","last_became_peered":"2023-10-06T03:53:44.657890+0000","last_unstale":"2023-10-06T03:55:31.524244+0000","last_undegraded":"2023-10-06T03:55:31.524244+0000","last_fullsized":"2023-10-06T03:55:31.524244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:31.523839+0000","last_clean_scrub_stamp":"2023-10-06T03:55:31.523839+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:39.553275+0000","scrub_duration":0.0040562519999999998,"objects_trimmed":0,"snaptrim_duration":0.010010550999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"27'23","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:03.880034+0000","last_change":"2023-10-06T03:56:03.879965+0000","last_active":"2023-10-06T03:56:03.880034+0000","last_peered":"2023-10-06T03:56:03.880034+0000","last_clean":"2023-10-06T03:56:03.880034+0000","last_became_active":"2023-10-06T03:53:44.655388+0000","last_became_peered":"2023-10-06T03:53:44.655388+0000","last_unstale":"2023-10-06T03:56:03.880034+0000","last_undegraded":"2023-10-06T03:56:03.880034+0000","last_fullsized":"2023-10-06T03:56:03.880034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2023-10-06T03:56:03.879647+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2023-10-06T03:56:03.879647+0000","last_clean_scrub_stamp":"2023-10-06T03:56:03.879647+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:57:06.992535+0000","scrub_duration":0.0041329790000000002,"objects_trimmed":0,"snaptrim_duration":0.017107009999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"27'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:58.686358+0000","last_change":"2023-10-06T03:55:58.686284+0000","last_active":"2023-10-06T03:55:58.686358+0000","last_peered":"2023-10-06T03:55:58.686358+0000","last_clean":"2023-10-06T03:55:58.686358+0000","last_became_active":"2023-10-06T03:53:44.662211+0000","last_became_peered":"2023-10-06T03:53:44.662211+0000","last_unstale":"2023-10-06T03:55:58.686358+0000","last_undegraded":"2023-10-06T03:55:58.686358+0000","last_fullsized":"2023-10-06T03:55:58.686358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2023-10-06T03:55:58.686012+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2023-10-06T03:55:58.686012+0000","last_clean_scrub_stamp":"2023-10-06T03:55:58.686012+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:42.583218+0000","scrub_duration":0.0042401080000000002,"objects_trimmed":0,"snaptrim_duration":0.0044403079999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.327041+0000","last_change":"2023-10-06T03:55:35.327007+0000","last_active":"2023-10-06T03:55:35.327041+0000","last_peered":"2023-10-06T03:55:35.327041+0000","last_clean":"2023-10-06T03:55:35.327041+0000","last_became_active":"2023-10-06T03:53:44.655365+0000","last_became_peered":"2023-10-06T03:53:44.655365+0000","last_unstale":"2023-10-06T03:55:35.327041+0000","last_undegraded":"2023-10-06T03:55:35.327041+0000","last_fullsized":"2023-10-06T03:55:35.327041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.326856+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.326856+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:04:52.589771+0000","scrub_duration":0.0029891750000000002,"objects_trimmed":0,"snaptrim_duration":0.010671256,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:49.411680+0000","last_change":"2023-10-06T03:55:49.411614+0000","last_active":"2023-10-06T03:55:49.411680+0000","last_peered":"2023-10-06T03:55:49.411680+0000","last_clean":"2023-10-06T03:55:49.411680+0000","last_became_active":"2023-10-06T03:53:44.668235+0000","last_became_peered":"2023-10-06T03:53:44.668235+0000","last_unstale":"2023-10-06T03:55:49.411680+0000","last_undegraded":"2023-10-06T03:55:49.411680+0000","last_fullsized":"2023-10-06T03:55:49.411680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:49.411294+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:49.411294+0000","last_clean_scrub_stamp":"2023-10-06T03:55:49.411294+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:57.196202+0000","scrub_duration":0.0039509840000000003,"objects_trimmed":0,"snaptrim_duration":0.0092769180000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'58","reported_seq":101,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.277410+0000","last_change":"2023-10-06T03:55:30.277342+0000","last_active":"2023-10-06T03:55:30.277410+0000","last_peered":"2023-10-06T03:55:30.277410+0000","last_clean":"2023-10-06T03:55:30.277410+0000","last_became_active":"2023-10-06T03:53:44.668637+0000","last_became_peered":"2023-10-06T03:53:44.668637+0000","last_unstale":"2023-10-06T03:55:30.277410+0000","last_undegraded":"2023-10-06T03:55:30.277410+0000","last_fullsized":"2023-10-06T03:55:30.277410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'58","last_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_deep_scrub":"27'58","last_deep_scrub_stamp":"2023-10-06T03:55:30.277075+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.277075+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:02:48.177630+0000","scrub_duration":0.0041351799999999996,"objects_trimmed":0,"snaptrim_duration":0.010557138000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.581076+0000","last_change":"2023-10-06T03:55:16.580993+0000","last_active":"2023-10-06T03:55:16.581076+0000","last_peered":"2023-10-06T03:55:16.581076+0000","last_clean":"2023-10-06T03:55:16.581076+0000","last_became_active":"2023-10-06T03:53:44.659764+0000","last_became_peered":"2023-10-06T03:53:44.659764+0000","last_unstale":"2023-10-06T03:55:16.581076+0000","last_undegraded":"2023-10-06T03:55:16.581076+0000","last_fullsized":"2023-10-06T03:55:16.581076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:16.580732+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.580732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:29.697352+0000","scrub_duration":0.0043988070000000002,"objects_trimmed":0,"snaptrim_duration":0.017044597000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:18.844477+0000","last_change":"2023-10-06T03:55:18.844353+0000","last_active":"2023-10-06T03:55:18.844477+0000","last_peered":"2023-10-06T03:55:18.844477+0000","last_clean":"2023-10-06T03:55:18.844477+0000","last_became_active":"2023-10-06T03:53:44.664259+0000","last_became_peered":"2023-10-06T03:53:44.664259+0000","last_unstale":"2023-10-06T03:55:18.844477+0000","last_undegraded":"2023-10-06T03:55:18.844477+0000","last_fullsized":"2023-10-06T03:55:18.844477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:55:18.844084+0000","last_clean_scrub_stamp":"2023-10-06T03:55:18.844084+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.508568+0000","scrub_duration":0.0043501169999999997,"objects_trimmed":0,"snaptrim_duration":0.0069042510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.178061+0000","last_change":"2023-10-06T03:55:05.759217+0000","last_active":"2023-10-06T03:55:10.178061+0000","last_peered":"2023-10-06T03:55:10.178061+0000","last_clean":"2023-10-06T03:55:10.178061+0000","last_became_active":"2023-10-06T03:53:44.665557+0000","last_became_peered":"2023-10-06T03:53:44.665557+0000","last_unstale":"2023-10-06T03:55:10.178061+0000","last_undegraded":"2023-10-06T03:55:10.178061+0000","last_fullsized":"2023-10-06T03:55:10.178061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:05.759109+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.759109+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.428927+0000","scrub_duration":0.010541894,"objects_trimmed":0,"snaptrim_duration":0.006884589,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'36","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.305313+0000","last_change":"2023-10-06T03:55:24.305239+0000","last_active":"2023-10-06T03:55:24.305313+0000","last_peered":"2023-10-06T03:55:24.305313+0000","last_clean":"2023-10-06T03:55:24.305313+0000","last_became_active":"2023-10-06T03:53:44.664297+0000","last_became_peered":"2023-10-06T03:53:44.664297+0000","last_unstale":"2023-10-06T03:55:24.305313+0000","last_undegraded":"2023-10-06T03:55:24.305313+0000","last_fullsized":"2023-10-06T03:55:24.305313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-10-06T03:55:24.304974+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.304974+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:28.003511+0000","scrub_duration":0.0047502239999999999,"objects_trimmed":0,"snaptrim_duration":0.010166412,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"27'33","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:55.652839+0000","last_change":"2023-10-06T03:55:55.652766+0000","last_active":"2023-10-06T03:55:55.652839+0000","last_peered":"2023-10-06T03:55:55.652839+0000","last_clean":"2023-10-06T03:55:55.652839+0000","last_became_active":"2023-10-06T03:53:44.662354+0000","last_became_peered":"2023-10-06T03:53:44.662354+0000","last_unstale":"2023-10-06T03:55:55.652839+0000","last_undegraded":"2023-10-06T03:55:55.652839+0000","last_fullsized":"2023-10-06T03:55:55.652839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:55:55.652465+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:55:55.652465+0000","last_clean_scrub_stamp":"2023-10-06T03:55:55.652465+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:16.488434+0000","scrub_duration":0.0042783810000000004,"objects_trimmed":0,"snaptrim_duration":0.0042743499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"27'40","reported_seq":83,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:56.923535+0000","last_change":"2023-10-06T03:55:56.923445+0000","last_active":"2023-10-06T03:55:56.923535+0000","last_peered":"2023-10-06T03:55:56.923535+0000","last_clean":"2023-10-06T03:55:56.923535+0000","last_became_active":"2023-10-06T03:53:44.655341+0000","last_became_peered":"2023-10-06T03:53:44.655341+0000","last_unstale":"2023-10-06T03:55:56.923535+0000","last_undegraded":"2023-10-06T03:55:56.923535+0000","last_fullsized":"2023-10-06T03:55:56.923535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2023-10-06T03:55:56.923140+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2023-10-06T03:55:56.923140+0000","last_clean_scrub_stamp":"2023-10-06T03:55:56.923140+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:33:51.032699+0000","scrub_duration":0.0048123690000000004,"objects_trimmed":0,"snaptrim_duration":0.016525431,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"27'32","reported_seq":84,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:36.536276+0000","last_change":"2023-10-06T03:55:36.536204+0000","last_active":"2023-10-06T03:55:36.536276+0000","last_peered":"2023-10-06T03:55:36.536276+0000","last_clean":"2023-10-06T03:55:36.536276+0000","last_became_active":"2023-10-06T03:54:26.786886+0000","last_became_peered":"2023-10-06T03:54:26.786886+0000","last_unstale":"2023-10-06T03:55:36.536276+0000","last_undegraded":"2023-10-06T03:55:36.536276+0000","last_fullsized":"2023-10-06T03:55:36.536276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:36.535946+0000","last_clean_scrub_stamp":"2023-10-06T03:55:36.535946+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:01.791835+0000","scrub_duration":0.0039438490000000001,"objects_trimmed":0,"snaptrim_duration":0.0096482700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"27'49","reported_seq":92,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:45.741178+0000","last_change":"2023-10-06T03:55:45.741107+0000","last_active":"2023-10-06T03:55:45.741178+0000","last_peered":"2023-10-06T03:55:45.741178+0000","last_clean":"2023-10-06T03:55:45.741178+0000","last_became_active":"2023-10-06T03:53:44.663649+0000","last_became_peered":"2023-10-06T03:53:44.663649+0000","last_unstale":"2023-10-06T03:55:45.741178+0000","last_undegraded":"2023-10-06T03:55:45.741178+0000","last_fullsized":"2023-10-06T03:55:45.741178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'49","last_scrub_stamp":"2023-10-06T03:55:45.740858+0000","last_deep_scrub":"27'49","last_deep_scrub_stamp":"2023-10-06T03:55:45.740858+0000","last_clean_scrub_stamp":"2023-10-06T03:55:45.740858+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:29.638063+0000","scrub_duration":0.0042111919999999999,"objects_trimmed":0,"snaptrim_duration":0.017171402999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.756421+0000","last_change":"2023-10-06T03:55:10.756346+0000","last_active":"2023-10-06T03:55:10.756421+0000","last_peered":"2023-10-06T03:55:10.756421+0000","last_clean":"2023-10-06T03:55:10.756421+0000","last_became_active":"2023-10-06T03:53:44.671115+0000","last_became_peered":"2023-10-06T03:53:44.671115+0000","last_unstale":"2023-10-06T03:55:10.756421+0000","last_undegraded":"2023-10-06T03:55:10.756421+0000","last_fullsized":"2023-10-06T03:55:10.756421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:10.756040+0000","last_clean_scrub_stamp":"2023-10-06T03:55:10.756040+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.124413+0000","scrub_duration":0.0040958310000000003,"objects_trimmed":0,"snaptrim_duration":0.0063946960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:51.891609+0000","last_change":"2023-10-06T03:55:51.891535+0000","last_active":"2023-10-06T03:55:51.891609+0000","last_peered":"2023-10-06T03:55:51.891609+0000","last_clean":"2023-10-06T03:55:51.891609+0000","last_became_active":"2023-10-06T03:53:44.659714+0000","last_became_peered":"2023-10-06T03:53:44.659714+0000","last_unstale":"2023-10-06T03:55:51.891609+0000","last_undegraded":"2023-10-06T03:55:51.891609+0000","last_fullsized":"2023-10-06T03:55:51.891609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:51.891248+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:51.891248+0000","last_clean_scrub_stamp":"2023-10-06T03:55:51.891248+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:45.151246+0000","scrub_duration":0.0037043689999999999,"objects_trimmed":0,"snaptrim_duration":0.017011842999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"27'44","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:57.660382+0000","last_change":"2023-10-06T03:55:57.660302+0000","last_active":"2023-10-06T03:55:57.660382+0000","last_peered":"2023-10-06T03:55:57.660382+0000","last_clean":"2023-10-06T03:55:57.660382+0000","last_became_active":"2023-10-06T03:53:44.673058+0000","last_became_peered":"2023-10-06T03:53:44.673058+0000","last_unstale":"2023-10-06T03:55:57.660382+0000","last_undegraded":"2023-10-06T03:55:57.660382+0000","last_fullsized":"2023-10-06T03:55:57.660382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-10-06T03:55:57.660019+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-10-06T03:55:57.660019+0000","last_clean_scrub_stamp":"2023-10-06T03:55:57.660019+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:05.444927+0000","scrub_duration":0.004553779,"objects_trimmed":0,"snaptrim_duration":0.0045883720000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.504426+0000","last_change":"2023-10-06T03:55:29.504313+0000","last_active":"2023-10-06T03:55:29.504426+0000","last_peered":"2023-10-06T03:55:29.504426+0000","last_clean":"2023-10-06T03:55:29.504426+0000","last_became_active":"2023-10-06T03:53:44.661700+0000","last_became_peered":"2023-10-06T03:53:44.661700+0000","last_unstale":"2023-10-06T03:55:29.504426+0000","last_undegraded":"2023-10-06T03:55:29.504426+0000","last_fullsized":"2023-10-06T03:55:29.504426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:29.503976+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.503976+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:34.797716+0000","scrub_duration":0.0038718749999999999,"objects_trimmed":0,"snaptrim_duration":0.010470313,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:58.306026+0000","last_change":"2023-10-06T03:55:58.305921+0000","last_active":"2023-10-06T03:55:58.306026+0000","last_peered":"2023-10-06T03:55:58.306026+0000","last_clean":"2023-10-06T03:55:58.306026+0000","last_became_active":"2023-10-06T03:53:44.671000+0000","last_became_peered":"2023-10-06T03:53:44.671000+0000","last_unstale":"2023-10-06T03:55:58.306026+0000","last_undegraded":"2023-10-06T03:55:58.306026+0000","last_fullsized":"2023-10-06T03:55:58.306026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:58.305625+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:58.305625+0000","last_clean_scrub_stamp":"2023-10-06T03:55:58.305625+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:18.127208+0000","scrub_duration":0.0041100140000000004,"objects_trimmed":0,"snaptrim_duration":0.0092240970000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"27'31","reported_seq":74,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:44.789111+0000","last_change":"2023-10-06T03:55:44.789049+0000","last_active":"2023-10-06T03:55:44.789111+0000","last_peered":"2023-10-06T03:55:44.789111+0000","last_clean":"2023-10-06T03:55:44.789111+0000","last_became_active":"2023-10-06T03:53:44.660840+0000","last_became_peered":"2023-10-06T03:53:44.660840+0000","last_unstale":"2023-10-06T03:55:44.789111+0000","last_undegraded":"2023-10-06T03:55:44.789111+0000","last_fullsized":"2023-10-06T03:55:44.789111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2023-10-06T03:55:44.788803+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2023-10-06T03:55:44.788803+0000","last_clean_scrub_stamp":"2023-10-06T03:55:44.788803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:10.044692+0000","scrub_duration":0.0044584380000000003,"objects_trimmed":0,"snaptrim_duration":0.0042144280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"27'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:38.561913+0000","last_change":"2023-10-06T03:55:38.561838+0000","last_active":"2023-10-06T03:55:38.561913+0000","last_peered":"2023-10-06T03:55:38.561913+0000","last_clean":"2023-10-06T03:55:38.561913+0000","last_became_active":"2023-10-06T03:53:44.671917+0000","last_became_peered":"2023-10-06T03:53:44.671917+0000","last_unstale":"2023-10-06T03:55:38.561913+0000","last_undegraded":"2023-10-06T03:55:38.561913+0000","last_fullsized":"2023-10-06T03:55:38.561913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2023-10-06T03:55:38.561562+0000","last_clean_scrub_stamp":"2023-10-06T03:55:38.561562+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.855302+0000","scrub_duration":0.0041220800000000002,"objects_trimmed":0,"snaptrim_duration":0.010852538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"27'53","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:29.631821+0000","last_change":"2023-10-06T03:55:29.631754+0000","last_active":"2023-10-06T03:55:29.631821+0000","last_peered":"2023-10-06T03:55:29.631821+0000","last_clean":"2023-10-06T03:55:29.631821+0000","last_became_active":"2023-10-06T03:53:44.670611+0000","last_became_peered":"2023-10-06T03:53:44.670611+0000","last_unstale":"2023-10-06T03:55:29.631821+0000","last_undegraded":"2023-10-06T03:55:29.631821+0000","last_fullsized":"2023-10-06T03:55:29.631821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2023-10-06T03:55:29.631489+0000","last_clean_scrub_stamp":"2023-10-06T03:55:29.631489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:42.748108+0000","scrub_duration":0.0040588150000000003,"objects_trimmed":0,"snaptrim_duration":0.0096577650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.342874+0000","last_change":"2023-10-06T03:55:32.342809+0000","last_active":"2023-10-06T03:55:32.342874+0000","last_peered":"2023-10-06T03:55:32.342874+0000","last_clean":"2023-10-06T03:55:32.342874+0000","last_became_active":"2023-10-06T03:53:44.663120+0000","last_became_peered":"2023-10-06T03:53:44.663120+0000","last_unstale":"2023-10-06T03:55:32.342874+0000","last_undegraded":"2023-10-06T03:55:32.342874+0000","last_fullsized":"2023-10-06T03:55:32.342874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:32.342538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.342538+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:03:38.710724+0000","scrub_duration":0.0042552450000000004,"objects_trimmed":0,"snaptrim_duration":0.0097876560000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"27'19","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.597821+0000","last_change":"2023-10-06T03:55:33.597725+0000","last_active":"2023-10-06T03:55:33.597821+0000","last_peered":"2023-10-06T03:55:33.597821+0000","last_clean":"2023-10-06T03:55:33.597821+0000","last_became_active":"2023-10-06T03:53:44.659920+0000","last_became_peered":"2023-10-06T03:53:44.659920+0000","last_unstale":"2023-10-06T03:55:33.597821+0000","last_undegraded":"2023-10-06T03:55:33.597821+0000","last_fullsized":"2023-10-06T03:55:33.597821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-10-06T03:55:33.597471+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.597471+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:23.977067+0000","scrub_duration":0.0041129490000000003,"objects_trimmed":0,"snaptrim_duration":0.010385257,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.069301+0000","last_change":"2023-10-06T03:55:35.069234+0000","last_active":"2023-10-06T03:55:35.069301+0000","last_peered":"2023-10-06T03:55:35.069301+0000","last_clean":"2023-10-06T03:55:35.069301+0000","last_became_active":"2023-10-06T03:53:44.664693+0000","last_became_peered":"2023-10-06T03:53:44.664693+0000","last_unstale":"2023-10-06T03:55:35.069301+0000","last_undegraded":"2023-10-06T03:55:35.069301+0000","last_fullsized":"2023-10-06T03:55:35.069301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:35.068954+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.068954+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:43.098390+0000","scrub_duration":0.0045654429999999998,"objects_trimmed":0,"snaptrim_duration":0.0091510959999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.180518+0000","last_change":"2023-10-06T03:55:04.638303+0000","last_active":"2023-10-06T03:55:10.180518+0000","last_peered":"2023-10-06T03:55:10.180518+0000","last_clean":"2023-10-06T03:55:10.180518+0000","last_became_active":"2023-10-06T03:53:44.663883+0000","last_became_peered":"2023-10-06T03:53:44.663883+0000","last_unstale":"2023-10-06T03:55:10.180518+0000","last_undegraded":"2023-10-06T03:55:10.180518+0000","last_fullsized":"2023-10-06T03:55:10.180518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:04.638053+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.638053+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:02.084340+0000","scrub_duration":0.0042471119999999999,"objects_trimmed":0,"snaptrim_duration":0.017042165000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"27'43","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:56.253261+0000","last_change":"2023-10-06T03:55:56.253194+0000","last_active":"2023-10-06T03:55:56.253261+0000","last_peered":"2023-10-06T03:55:56.253261+0000","last_clean":"2023-10-06T03:55:56.253261+0000","last_became_active":"2023-10-06T03:53:44.669774+0000","last_became_peered":"2023-10-06T03:53:44.669774+0000","last_unstale":"2023-10-06T03:55:56.253261+0000","last_undegraded":"2023-10-06T03:55:56.253261+0000","last_fullsized":"2023-10-06T03:55:56.253261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2023-10-06T03:55:56.252892+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2023-10-06T03:55:56.252892+0000","last_clean_scrub_stamp":"2023-10-06T03:55:56.252892+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:27.078112+0000","scrub_duration":0.0039321,"objects_trimmed":0,"snaptrim_duration":0.010478619,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.362644+0000","last_change":"2023-10-06T03:55:35.362577+0000","last_active":"2023-10-06T03:55:35.362644+0000","last_peered":"2023-10-06T03:55:35.362644+0000","last_clean":"2023-10-06T03:55:35.362644+0000","last_became_active":"2023-10-06T03:53:44.663905+0000","last_became_peered":"2023-10-06T03:53:44.663905+0000","last_unstale":"2023-10-06T03:55:35.362644+0000","last_undegraded":"2023-10-06T03:55:35.362644+0000","last_fullsized":"2023-10-06T03:55:35.362644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:35.362319+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.362319+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:48.478939+0000","scrub_duration":0.0041746999999999999,"objects_trimmed":0,"snaptrim_duration":0.007180461,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"27'44","reported_seq":87,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.058107+0000","last_change":"2023-10-06T03:55:40.058037+0000","last_active":"2023-10-06T03:55:40.058107+0000","last_peered":"2023-10-06T03:55:40.058107+0000","last_clean":"2023-10-06T03:55:40.058107+0000","last_became_active":"2023-10-06T03:53:44.666368+0000","last_became_peered":"2023-10-06T03:53:44.666368+0000","last_unstale":"2023-10-06T03:55:40.058107+0000","last_undegraded":"2023-10-06T03:55:40.058107+0000","last_fullsized":"2023-10-06T03:55:40.058107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2023-10-06T03:55:40.057731+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.057731+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:05.313619+0000","scrub_duration":0.0036339419999999998,"objects_trimmed":0,"snaptrim_duration":0.010865144,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.586469+0000","last_change":"2023-10-06T03:55:25.586350+0000","last_active":"2023-10-06T03:55:25.586469+0000","last_peered":"2023-10-06T03:55:25.586469+0000","last_clean":"2023-10-06T03:55:25.586469+0000","last_became_active":"2023-10-06T03:53:43.658366+0000","last_became_peered":"2023-10-06T03:53:43.658366+0000","last_unstale":"2023-10-06T03:55:25.586469+0000","last_undegraded":"2023-10-06T03:55:25.586469+0000","last_fullsized":"2023-10-06T03:55:25.586469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:25.586087+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.586087+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:38.702706+0000","scrub_duration":0.0086854250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'30","reported_seq":73,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.319007+0000","last_change":"2023-10-06T03:55:25.318947+0000","last_active":"2023-10-06T03:55:25.319007+0000","last_peered":"2023-10-06T03:55:25.319007+0000","last_clean":"2023-10-06T03:55:25.319007+0000","last_became_active":"2023-10-06T03:53:44.660752+0000","last_became_peered":"2023-10-06T03:53:44.660752+0000","last_unstale":"2023-10-06T03:55:25.319007+0000","last_undegraded":"2023-10-06T03:55:25.319007+0000","last_fullsized":"2023-10-06T03:55:25.319007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2023-10-06T03:55:25.318651+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.318651+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:51.036219+0000","scrub_duration":0.0041645750000000002,"objects_trimmed":0,"snaptrim_duration":0.0097426309999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.509563+0000","last_change":"2023-10-06T03:55:12.509433+0000","last_active":"2023-10-06T03:55:12.509563+0000","last_peered":"2023-10-06T03:55:12.509563+0000","last_clean":"2023-10-06T03:55:12.509563+0000","last_became_active":"2023-10-06T03:53:43.655510+0000","last_became_peered":"2023-10-06T03:53:43.655510+0000","last_unstale":"2023-10-06T03:55:12.509563+0000","last_undegraded":"2023-10-06T03:55:12.509563+0000","last_fullsized":"2023-10-06T03:55:12.509563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.509162+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.509162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:45.173964+0000","scrub_duration":0.004617454,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.546069+0000","last_change":"2023-10-06T03:55:30.546003+0000","last_active":"2023-10-06T03:55:30.546069+0000","last_peered":"2023-10-06T03:55:30.546069+0000","last_clean":"2023-10-06T03:55:30.546069+0000","last_became_active":"2023-10-06T03:53:44.668091+0000","last_became_peered":"2023-10-06T03:53:44.668091+0000","last_unstale":"2023-10-06T03:55:30.546069+0000","last_undegraded":"2023-10-06T03:55:30.546069+0000","last_fullsized":"2023-10-06T03:55:30.546069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:30.545739+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.545739+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:05.910393+0000","scrub_duration":0.0038579909999999999,"objects_trimmed":0,"snaptrim_duration":0.0097705469999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.612194+0000","last_change":"2023-10-06T03:55:19.612128+0000","last_active":"2023-10-06T03:55:19.612194+0000","last_peered":"2023-10-06T03:55:19.612194+0000","last_clean":"2023-10-06T03:55:19.612194+0000","last_became_active":"2023-10-06T03:53:43.656399+0000","last_became_peered":"2023-10-06T03:53:43.656399+0000","last_unstale":"2023-10-06T03:55:19.612194+0000","last_undegraded":"2023-10-06T03:55:19.612194+0000","last_fullsized":"2023-10-06T03:55:19.612194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:19.611867+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.611867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:23.143979+0000","scrub_duration":0.0039385999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'38","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:51.178896+0000","last_change":"2023-10-06T03:55:51.178834+0000","last_active":"2023-10-06T03:55:51.178896+0000","last_peered":"2023-10-06T03:55:51.178896+0000","last_clean":"2023-10-06T03:55:51.178896+0000","last_became_active":"2023-10-06T03:53:44.661712+0000","last_became_peered":"2023-10-06T03:53:44.661712+0000","last_unstale":"2023-10-06T03:55:51.178896+0000","last_undegraded":"2023-10-06T03:55:51.178896+0000","last_fullsized":"2023-10-06T03:55:51.178896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-10-06T03:55:51.178580+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-10-06T03:55:51.178580+0000","last_clean_scrub_stamp":"2023-10-06T03:55:51.178580+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:12.014549+0000","scrub_duration":0.0041793009999999998,"objects_trimmed":0,"snaptrim_duration":0.01003823,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"30'13","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:11.262927+0000","last_change":"2023-10-06T03:55:11.262836+0000","last_active":"2023-10-06T03:55:11.262927+0000","last_peered":"2023-10-06T03:55:11.262927+0000","last_clean":"2023-10-06T03:55:11.262927+0000","last_became_active":"2023-10-06T03:53:43.660370+0000","last_became_peered":"2023-10-06T03:53:43.660370+0000","last_unstale":"2023-10-06T03:55:11.262927+0000","last_undegraded":"2023-10-06T03:55:11.262927+0000","last_fullsized":"2023-10-06T03:55:11.262927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2023-10-06T03:55:11.262564+0000","last_clean_scrub_stamp":"2023-10-06T03:55:11.262564+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.630938+0000","scrub_duration":0.010133995999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"30'2","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:00.738776+0000","last_change":"2023-10-06T03:56:00.738709+0000","last_active":"2023-10-06T03:56:00.738776+0000","last_peered":"2023-10-06T03:56:00.738776+0000","last_clean":"2023-10-06T03:56:00.738776+0000","last_became_active":"2023-10-06T03:53:43.656085+0000","last_became_peered":"2023-10-06T03:53:43.656085+0000","last_unstale":"2023-10-06T03:56:00.738776+0000","last_undegraded":"2023-10-06T03:56:00.738776+0000","last_fullsized":"2023-10-06T03:56:00.738776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-10-06T03:56:00.738436+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-10-06T03:56:00.738436+0000","last_clean_scrub_stamp":"2023-10-06T03:56:00.738436+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:31.563655+0000","scrub_duration":0.0078768870000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.280506+0000","last_change":"2023-10-06T03:55:23.280427+0000","last_active":"2023-10-06T03:55:23.280506+0000","last_peered":"2023-10-06T03:55:23.280506+0000","last_clean":"2023-10-06T03:55:23.280506+0000","last_became_active":"2023-10-06T03:53:44.658931+0000","last_became_peered":"2023-10-06T03:53:44.658931+0000","last_unstale":"2023-10-06T03:55:23.280506+0000","last_undegraded":"2023-10-06T03:55:23.280506+0000","last_fullsized":"2023-10-06T03:55:23.280506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:23.280171+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.280171+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:28.862189+0000","scrub_duration":0.0036857880000000002,"objects_trimmed":0,"snaptrim_duration":0.010236192999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.573120+0000","last_change":"2023-10-06T03:55:26.573033+0000","last_active":"2023-10-06T03:55:26.573120+0000","last_peered":"2023-10-06T03:55:26.573120+0000","last_clean":"2023-10-06T03:55:26.573120+0000","last_became_active":"2023-10-06T03:53:43.657114+0000","last_became_peered":"2023-10-06T03:53:43.657114+0000","last_unstale":"2023-10-06T03:55:26.573120+0000","last_undegraded":"2023-10-06T03:55:26.573120+0000","last_fullsized":"2023-10-06T03:55:26.573120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:26.572789+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.572789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:33.490031+0000","scrub_duration":0.0067112960000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'10","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:49.841050+0000","last_change":"2023-10-06T03:55:49.840979+0000","last_active":"2023-10-06T03:55:49.841050+0000","last_peered":"2023-10-06T03:55:49.841050+0000","last_clean":"2023-10-06T03:55:49.841050+0000","last_became_active":"2023-10-06T03:53:44.661468+0000","last_became_peered":"2023-10-06T03:53:44.661468+0000","last_unstale":"2023-10-06T03:55:49.841050+0000","last_undegraded":"2023-10-06T03:55:49.841050+0000","last_fullsized":"2023-10-06T03:55:49.841050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2023-10-06T03:55:49.840705+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2023-10-06T03:55:49.840705+0000","last_clean_scrub_stamp":"2023-10-06T03:55:49.840705+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:09.662288+0000","scrub_duration":0.0042542589999999998,"objects_trimmed":0,"snaptrim_duration":0.016897651999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"30'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.658046+0000","last_change":"2023-10-06T03:55:34.657973+0000","last_active":"2023-10-06T03:55:34.658046+0000","last_peered":"2023-10-06T03:55:34.658046+0000","last_clean":"2023-10-06T03:55:34.658046+0000","last_became_active":"2023-10-06T03:53:43.656045+0000","last_became_peered":"2023-10-06T03:53:43.656045+0000","last_unstale":"2023-10-06T03:55:34.658046+0000","last_undegraded":"2023-10-06T03:55:34.658046+0000","last_fullsized":"2023-10-06T03:55:34.658046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2023-10-06T03:55:34.657722+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.657722+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:21.606660+0000","scrub_duration":0.0072249790000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"27'24","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.365499+0000","last_change":"2023-10-06T03:55:28.365395+0000","last_active":"2023-10-06T03:55:28.365499+0000","last_peered":"2023-10-06T03:55:28.365499+0000","last_clean":"2023-10-06T03:55:28.365499+0000","last_became_active":"2023-10-06T03:53:44.663000+0000","last_became_peered":"2023-10-06T03:53:44.663000+0000","last_unstale":"2023-10-06T03:55:28.365499+0000","last_undegraded":"2023-10-06T03:55:28.365499+0000","last_fullsized":"2023-10-06T03:55:28.365499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2023-10-06T03:55:28.365138+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.365138+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:01.029940+0000","scrub_duration":0.0043556419999999998,"objects_trimmed":0,"snaptrim_duration":0.0063459989999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.380585+0000","last_change":"2023-10-06T03:55:06.380488+0000","last_active":"2023-10-06T03:55:06.380585+0000","last_peered":"2023-10-06T03:55:06.380585+0000","last_clean":"2023-10-06T03:55:06.380585+0000","last_became_active":"2023-10-06T03:53:43.667555+0000","last_became_peered":"2023-10-06T03:53:43.667555+0000","last_unstale":"2023-10-06T03:55:06.380585+0000","last_undegraded":"2023-10-06T03:55:06.380585+0000","last_fullsized":"2023-10-06T03:55:06.380585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:06.380239+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.380239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:51:10.084652+0000","scrub_duration":0.0039703960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'39","reported_seq":82,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:54.466759+0000","last_change":"2023-10-06T03:55:54.466642+0000","last_active":"2023-10-06T03:55:54.466759+0000","last_peered":"2023-10-06T03:55:54.466759+0000","last_clean":"2023-10-06T03:55:54.466759+0000","last_became_active":"2023-10-06T03:53:44.662460+0000","last_became_peered":"2023-10-06T03:53:44.662460+0000","last_unstale":"2023-10-06T03:55:54.466759+0000","last_undegraded":"2023-10-06T03:55:54.466759+0000","last_fullsized":"2023-10-06T03:55:54.466759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2023-10-06T03:55:54.466203+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2023-10-06T03:55:54.466203+0000","last_clean_scrub_stamp":"2023-10-06T03:55:54.466203+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:40:14.287786+0000","scrub_duration":0.004285334,"objects_trimmed":0,"snaptrim_duration":0.0091432119999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.703876+0000","last_change":"2023-10-06T03:55:16.703748+0000","last_active":"2023-10-06T03:55:16.703876+0000","last_peered":"2023-10-06T03:55:16.703876+0000","last_clean":"2023-10-06T03:55:16.703876+0000","last_became_active":"2023-10-06T03:53:43.666693+0000","last_became_peered":"2023-10-06T03:53:43.666693+0000","last_unstale":"2023-10-06T03:55:16.703876+0000","last_undegraded":"2023-10-06T03:55:16.703876+0000","last_fullsized":"2023-10-06T03:55:16.703876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:16.703443+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.703443+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:49.368245+0000","scrub_duration":0.011084629,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:40.656552+0000","last_change":"2023-10-06T03:55:40.656426+0000","last_active":"2023-10-06T03:55:40.656552+0000","last_peered":"2023-10-06T03:55:40.656552+0000","last_clean":"2023-10-06T03:55:40.656552+0000","last_became_active":"2023-10-06T03:53:44.657977+0000","last_became_peered":"2023-10-06T03:53:44.657977+0000","last_unstale":"2023-10-06T03:55:40.656552+0000","last_undegraded":"2023-10-06T03:55:40.656552+0000","last_fullsized":"2023-10-06T03:55:40.656552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:40.656149+0000","last_clean_scrub_stamp":"2023-10-06T03:55:40.656149+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:47:05.110491+0000","scrub_duration":0.0040888000000000001,"objects_trimmed":0,"snaptrim_duration":0.017145036999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.301487+0000","last_change":"2023-10-06T03:55:13.301391+0000","last_active":"2023-10-06T03:55:13.301487+0000","last_peered":"2023-10-06T03:55:13.301487+0000","last_clean":"2023-10-06T03:55:13.301487+0000","last_became_active":"2023-10-06T03:53:43.652921+0000","last_became_peered":"2023-10-06T03:53:43.652921+0000","last_unstale":"2023-10-06T03:55:13.301487+0000","last_undegraded":"2023-10-06T03:55:13.301487+0000","last_fullsized":"2023-10-06T03:55:13.301487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.301122+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.301122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:24.401627+0000","scrub_duration":0.0044995039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:42.737055+0000","last_change":"2023-10-06T03:55:42.736955+0000","last_active":"2023-10-06T03:55:42.737055+0000","last_peered":"2023-10-06T03:55:42.737055+0000","last_clean":"2023-10-06T03:55:42.737055+0000","last_became_active":"2023-10-06T03:53:44.663486+0000","last_became_peered":"2023-10-06T03:53:44.663486+0000","last_unstale":"2023-10-06T03:55:42.737055+0000","last_undegraded":"2023-10-06T03:55:42.737055+0000","last_fullsized":"2023-10-06T03:55:42.737055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:42.736691+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:42.736691+0000","last_clean_scrub_stamp":"2023-10-06T03:55:42.736691+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:03.572661+0000","scrub_duration":0.004662167,"objects_trimmed":0,"snaptrim_duration":0.017135524999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.634668+0000","last_change":"2023-10-06T03:55:20.634606+0000","last_active":"2023-10-06T03:55:20.634668+0000","last_peered":"2023-10-06T03:55:20.634668+0000","last_clean":"2023-10-06T03:55:20.634668+0000","last_became_active":"2023-10-06T03:53:43.644821+0000","last_became_peered":"2023-10-06T03:53:43.644821+0000","last_unstale":"2023-10-06T03:55:20.634668+0000","last_undegraded":"2023-10-06T03:55:20.634668+0000","last_fullsized":"2023-10-06T03:55:20.634668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.634345+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.634345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:11.013941+0000","scrub_duration":0.0041101649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"27'22","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:35.629081+0000","last_change":"2023-10-06T03:55:35.628954+0000","last_active":"2023-10-06T03:55:35.629081+0000","last_peered":"2023-10-06T03:55:35.629081+0000","last_clean":"2023-10-06T03:55:35.629081+0000","last_became_active":"2023-10-06T03:53:44.663826+0000","last_became_peered":"2023-10-06T03:53:44.663826+0000","last_unstale":"2023-10-06T03:55:35.629081+0000","last_undegraded":"2023-10-06T03:55:35.629081+0000","last_fullsized":"2023-10-06T03:55:35.629081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2023-10-06T03:55:35.628683+0000","last_clean_scrub_stamp":"2023-10-06T03:55:35.628683+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:14.448761+0000","scrub_duration":0.0037000319999999998,"objects_trimmed":0,"snaptrim_duration":0.017297254000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:08.771338+0000","last_change":"2023-10-06T03:55:08.771121+0000","last_active":"2023-10-06T03:55:08.771338+0000","last_peered":"2023-10-06T03:55:08.771338+0000","last_clean":"2023-10-06T03:55:08.771338+0000","last_became_active":"2023-10-06T03:53:43.657021+0000","last_became_peered":"2023-10-06T03:53:43.657021+0000","last_unstale":"2023-10-06T03:55:08.771338+0000","last_undegraded":"2023-10-06T03:55:08.771338+0000","last_fullsized":"2023-10-06T03:55:08.771338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:08.770817+0000","last_clean_scrub_stamp":"2023-10-06T03:55:08.770817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:34.435300+0000","scrub_duration":0.0040354609999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:37.545844+0000","last_change":"2023-10-06T03:55:37.545705+0000","last_active":"2023-10-06T03:55:37.545844+0000","last_peered":"2023-10-06T03:55:37.545844+0000","last_clean":"2023-10-06T03:55:37.545844+0000","last_became_active":"2023-10-06T03:53:44.666457+0000","last_became_peered":"2023-10-06T03:53:44.666457+0000","last_unstale":"2023-10-06T03:55:37.545844+0000","last_undegraded":"2023-10-06T03:55:37.545844+0000","last_fullsized":"2023-10-06T03:55:37.545844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:37.545413+0000","last_clean_scrub_stamp":"2023-10-06T03:55:37.545413+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:24.494352+0000","scrub_duration":0.0038541280000000001,"objects_trimmed":0,"snaptrim_duration":0.0099655790000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.640255+0000","last_change":"2023-10-06T03:55:07.640070+0000","last_active":"2023-10-06T03:55:07.640255+0000","last_peered":"2023-10-06T03:55:07.640255+0000","last_clean":"2023-10-06T03:55:07.640255+0000","last_became_active":"2023-10-06T03:53:34.867475+0000","last_became_peered":"2023-10-06T03:53:34.867475+0000","last_unstale":"2023-10-06T03:55:07.640255+0000","last_undegraded":"2023-10-06T03:55:07.640255+0000","last_fullsized":"2023-10-06T03:55:07.640255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-10-06T03:55:07.639807+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.639807+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.740312+0000","scrub_duration":0.013574480999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.382170+0000","last_change":"2023-10-06T03:55:05.381563+0000","last_active":"2023-10-06T03:55:05.382170+0000","last_peered":"2023-10-06T03:55:05.382170+0000","last_clean":"2023-10-06T03:55:05.382170+0000","last_became_active":"2023-10-06T03:53:39.498331+0000","last_became_peered":"2023-10-06T03:53:39.498331+0000","last_unstale":"2023-10-06T03:55:05.382170+0000","last_undegraded":"2023-10-06T03:55:05.382170+0000","last_fullsized":"2023-10-06T03:55:05.382170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.381223+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.381223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:37.257218+0000","scrub_duration":0.0045535489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:27.887604+0000","last_change":"2023-10-06T03:55:27.887534+0000","last_active":"2023-10-06T03:55:27.887604+0000","last_peered":"2023-10-06T03:55:27.887604+0000","last_clean":"2023-10-06T03:55:27.887604+0000","last_became_active":"2023-10-06T03:53:43.661588+0000","last_became_peered":"2023-10-06T03:53:43.661588+0000","last_unstale":"2023-10-06T03:55:27.887604+0000","last_undegraded":"2023-10-06T03:55:27.887604+0000","last_fullsized":"2023-10-06T03:55:27.887604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:27.887241+0000","last_clean_scrub_stamp":"2023-10-06T03:55:27.887241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:18.266837+0000","scrub_duration":0.0040139879999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.267114+0000","last_change":"2023-10-06T03:55:19.266995+0000","last_active":"2023-10-06T03:55:19.267114+0000","last_peered":"2023-10-06T03:55:19.267114+0000","last_clean":"2023-10-06T03:55:19.267114+0000","last_became_active":"2023-10-06T03:53:44.657955+0000","last_became_peered":"2023-10-06T03:53:44.657955+0000","last_unstale":"2023-10-06T03:55:19.267114+0000","last_undegraded":"2023-10-06T03:55:19.267114+0000","last_fullsized":"2023-10-06T03:55:19.267114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:19.266595+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.266595+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:44.931079+0000","scrub_duration":0.004022856,"objects_trimmed":0,"snaptrim_duration":0.006907687,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.633309+0000","last_change":"2023-10-06T03:55:12.633170+0000","last_active":"2023-10-06T03:55:12.633309+0000","last_peered":"2023-10-06T03:55:12.633309+0000","last_clean":"2023-10-06T03:55:12.633309+0000","last_became_active":"2023-10-06T03:53:39.498335+0000","last_became_peered":"2023-10-06T03:53:39.498335+0000","last_unstale":"2023-10-06T03:55:12.633309+0000","last_undegraded":"2023-10-06T03:55:12.633309+0000","last_fullsized":"2023-10-06T03:55:12.633309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:12.632897+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.632897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:38.297380+0000","scrub_duration":0.005677596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'16","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:19.486436+0000","last_change":"2023-10-06T03:55:19.486358+0000","last_active":"2023-10-06T03:55:19.486436+0000","last_peered":"2023-10-06T03:55:19.486436+0000","last_clean":"2023-10-06T03:55:19.486436+0000","last_became_active":"2023-10-06T03:53:43.654891+0000","last_became_peered":"2023-10-06T03:53:43.654891+0000","last_unstale":"2023-10-06T03:55:19.486436+0000","last_undegraded":"2023-10-06T03:55:19.486436+0000","last_fullsized":"2023-10-06T03:55:19.486436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2023-10-06T03:55:19.486077+0000","last_clean_scrub_stamp":"2023-10-06T03:55:19.486077+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:32.602697+0000","scrub_duration":0.0050046780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5555,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'35","reported_seq":78,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:47.352672+0000","last_change":"2023-10-06T03:55:47.352555+0000","last_active":"2023-10-06T03:55:47.352672+0000","last_peered":"2023-10-06T03:55:47.352672+0000","last_clean":"2023-10-06T03:55:47.352672+0000","last_became_active":"2023-10-06T03:53:44.662514+0000","last_became_peered":"2023-10-06T03:53:44.662514+0000","last_unstale":"2023-10-06T03:55:47.352672+0000","last_undegraded":"2023-10-06T03:55:47.352672+0000","last_fullsized":"2023-10-06T03:55:47.352672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:47.352113+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:47.352113+0000","last_clean_scrub_stamp":"2023-10-06T03:55:47.352113+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:08.188082+0000","scrub_duration":0.0042301930000000001,"objects_trimmed":0,"snaptrim_duration":0.0095532519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.388616+0000","last_change":"2023-10-06T03:55:03.796402+0000","last_active":"2023-10-06T03:55:05.388616+0000","last_peered":"2023-10-06T03:55:05.388616+0000","last_clean":"2023-10-06T03:55:05.388616+0000","last_became_active":"2023-10-06T03:53:39.603865+0000","last_became_peered":"2023-10-06T03:53:39.603865+0000","last_unstale":"2023-10-06T03:55:05.388616+0000","last_undegraded":"2023-10-06T03:55:05.388616+0000","last_fullsized":"2023-10-06T03:55:05.388616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:03.796132+0000","last_clean_scrub_stamp":"2023-10-06T03:55:03.796132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:08:06.103535+0000","scrub_duration":0.0035169239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.496877+0000","last_change":"2023-10-06T03:55:13.496803+0000","last_active":"2023-10-06T03:55:13.496877+0000","last_peered":"2023-10-06T03:55:13.496877+0000","last_clean":"2023-10-06T03:55:13.496877+0000","last_became_active":"2023-10-06T03:53:43.648351+0000","last_became_peered":"2023-10-06T03:53:43.648351+0000","last_unstale":"2023-10-06T03:55:13.496877+0000","last_undegraded":"2023-10-06T03:55:13.496877+0000","last_fullsized":"2023-10-06T03:55:13.496877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:13.496501+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.496501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:39.160985+0000","scrub_duration":0.0059863599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'28","reported_seq":71,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:30.606531+0000","last_change":"2023-10-06T03:55:30.606439+0000","last_active":"2023-10-06T03:55:30.606531+0000","last_peered":"2023-10-06T03:55:30.606531+0000","last_clean":"2023-10-06T03:55:30.606531+0000","last_became_active":"2023-10-06T03:53:44.659594+0000","last_became_peered":"2023-10-06T03:53:44.659594+0000","last_unstale":"2023-10-06T03:55:30.606531+0000","last_undegraded":"2023-10-06T03:55:30.606531+0000","last_fullsized":"2023-10-06T03:55:30.606531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2023-10-06T03:55:30.606178+0000","last_clean_scrub_stamp":"2023-10-06T03:55:30.606178+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:37.523420+0000","scrub_duration":0.0047520510000000002,"objects_trimmed":0,"snaptrim_duration":0.010907283,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.381440+0000","last_change":"2023-10-06T03:55:04.330738+0000","last_active":"2023-10-06T03:55:05.381440+0000","last_peered":"2023-10-06T03:55:05.381440+0000","last_clean":"2023-10-06T03:55:05.381440+0000","last_became_active":"2023-10-06T03:53:39.498832+0000","last_became_peered":"2023-10-06T03:53:39.498832+0000","last_unstale":"2023-10-06T03:55:05.381440+0000","last_undegraded":"2023-10-06T03:55:05.381440+0000","last_fullsized":"2023-10-06T03:55:05.381440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:04.330335+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.330335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:35:41.964328+0000","scrub_duration":0.004180291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.570701+0000","last_change":"2023-10-06T03:55:24.570637+0000","last_active":"2023-10-06T03:55:24.570701+0000","last_peered":"2023-10-06T03:55:24.570701+0000","last_clean":"2023-10-06T03:55:24.570701+0000","last_became_active":"2023-10-06T03:53:43.660240+0000","last_became_peered":"2023-10-06T03:53:43.660240+0000","last_unstale":"2023-10-06T03:55:24.570701+0000","last_undegraded":"2023-10-06T03:55:24.570701+0000","last_fullsized":"2023-10-06T03:55:24.570701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:24.570374+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.570374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:11.519312+0000","scrub_duration":0.0037479179999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"27'35","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.349129+0000","last_change":"2023-10-06T03:55:39.349071+0000","last_active":"2023-10-06T03:55:39.349129+0000","last_peered":"2023-10-06T03:55:39.349129+0000","last_clean":"2023-10-06T03:55:39.349129+0000","last_became_active":"2023-10-06T03:54:26.783289+0000","last_became_peered":"2023-10-06T03:54:26.783289+0000","last_unstale":"2023-10-06T03:55:39.349129+0000","last_undegraded":"2023-10-06T03:55:39.349129+0000","last_fullsized":"2023-10-06T03:55:39.349129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2023-10-06T03:55:39.348847+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.348847+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:56.849541+0000","scrub_duration":0.0038212530000000001,"objects_trimmed":0,"snaptrim_duration":0.010188835,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:12.293117+0000","last_change":"2023-10-06T03:55:12.293033+0000","last_active":"2023-10-06T03:55:12.293117+0000","last_peered":"2023-10-06T03:55:12.293117+0000","last_clean":"2023-10-06T03:55:12.293117+0000","last_became_active":"2023-10-06T03:53:43.667427+0000","last_became_peered":"2023-10-06T03:53:43.667427+0000","last_unstale":"2023-10-06T03:55:12.293117+0000","last_undegraded":"2023-10-06T03:55:12.293117+0000","last_fullsized":"2023-10-06T03:55:12.293117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:12.292753+0000","last_clean_scrub_stamp":"2023-10-06T03:55:12.292753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:14.664468+0000","scrub_duration":0.004434566,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.520693+0000","last_change":"2023-10-06T03:55:07.520556+0000","last_active":"2023-10-06T03:55:07.520693+0000","last_peered":"2023-10-06T03:55:07.520693+0000","last_clean":"2023-10-06T03:55:07.520693+0000","last_became_active":"2023-10-06T03:53:39.499350+0000","last_became_peered":"2023-10-06T03:53:39.499350+0000","last_unstale":"2023-10-06T03:55:07.520693+0000","last_undegraded":"2023-10-06T03:55:07.520693+0000","last_fullsized":"2023-10-06T03:55:07.520693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:07.520348+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.520348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:11:18.620853+0000","scrub_duration":0.003511218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.548926+0000","last_change":"2023-10-06T03:55:39.548799+0000","last_active":"2023-10-06T03:55:39.548926+0000","last_peered":"2023-10-06T03:55:39.548926+0000","last_clean":"2023-10-06T03:55:39.548926+0000","last_became_active":"2023-10-06T03:53:44.659718+0000","last_became_peered":"2023-10-06T03:53:44.659718+0000","last_unstale":"2023-10-06T03:55:39.548926+0000","last_undegraded":"2023-10-06T03:55:39.548926+0000","last_fullsized":"2023-10-06T03:55:39.548926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:39.548474+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.548474+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:14.913128+0000","scrub_duration":0.0044120610000000001,"objects_trimmed":0,"snaptrim_duration":0.010698005999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:16.458936+0000","last_change":"2023-10-06T03:55:16.458859+0000","last_active":"2023-10-06T03:55:16.458936+0000","last_peered":"2023-10-06T03:55:16.458936+0000","last_clean":"2023-10-06T03:55:16.458936+0000","last_became_active":"2023-10-06T03:53:43.656269+0000","last_became_peered":"2023-10-06T03:53:43.656269+0000","last_unstale":"2023-10-06T03:55:16.458936+0000","last_undegraded":"2023-10-06T03:55:16.458936+0000","last_fullsized":"2023-10-06T03:55:16.458936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:16.458563+0000","last_clean_scrub_stamp":"2023-10-06T03:55:16.458563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:13.904851+0000","scrub_duration":0.0042922999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:13.633759+0000","last_change":"2023-10-06T03:55:13.633679+0000","last_active":"2023-10-06T03:55:13.633759+0000","last_peered":"2023-10-06T03:55:13.633759+0000","last_clean":"2023-10-06T03:55:13.633759+0000","last_became_active":"2023-10-06T03:53:39.493314+0000","last_became_peered":"2023-10-06T03:53:39.493314+0000","last_unstale":"2023-10-06T03:55:13.633759+0000","last_undegraded":"2023-10-06T03:55:13.633759+0000","last_fullsized":"2023-10-06T03:55:13.633759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:13.633435+0000","last_clean_scrub_stamp":"2023-10-06T03:55:13.633435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:11.079723+0000","scrub_duration":0.004040732,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'25","reported_seq":68,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:52.474736+0000","last_change":"2023-10-06T03:55:52.474659+0000","last_active":"2023-10-06T03:55:52.474736+0000","last_peered":"2023-10-06T03:55:52.474736+0000","last_clean":"2023-10-06T03:55:52.474736+0000","last_became_active":"2023-10-06T03:53:44.662059+0000","last_became_peered":"2023-10-06T03:53:44.662059+0000","last_unstale":"2023-10-06T03:55:52.474736+0000","last_undegraded":"2023-10-06T03:55:52.474736+0000","last_fullsized":"2023-10-06T03:55:52.474736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2023-10-06T03:55:52.474383+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2023-10-06T03:55:52.474383+0000","last_clean_scrub_stamp":"2023-10-06T03:55:52.474383+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:23.299603+0000","scrub_duration":0.0042178220000000004,"objects_trimmed":0,"snaptrim_duration":0.0093781690000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"30'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:23.860757+0000","last_change":"2023-10-06T03:55:23.860690+0000","last_active":"2023-10-06T03:55:23.860757+0000","last_peered":"2023-10-06T03:55:23.860757+0000","last_clean":"2023-10-06T03:55:23.860757+0000","last_became_active":"2023-10-06T03:53:43.655607+0000","last_became_peered":"2023-10-06T03:53:43.655607+0000","last_unstale":"2023-10-06T03:55:23.860757+0000","last_undegraded":"2023-10-06T03:55:23.860757+0000","last_fullsized":"2023-10-06T03:55:23.860757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2023-10-06T03:55:23.860446+0000","last_clean_scrub_stamp":"2023-10-06T03:55:23.860446+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:51:36.977065+0000","scrub_duration":0.0090851030000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:05.506143+0000","last_change":"2023-10-06T03:55:05.502487+0000","last_active":"2023-10-06T03:55:05.506143+0000","last_peered":"2023-10-06T03:55:05.506143+0000","last_clean":"2023-10-06T03:55:05.506143+0000","last_became_active":"2023-10-06T03:53:39.499021+0000","last_became_peered":"2023-10-06T03:53:39.499021+0000","last_unstale":"2023-10-06T03:55:05.506143+0000","last_undegraded":"2023-10-06T03:55:05.506143+0000","last_fullsized":"2023-10-06T03:55:05.506143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:05.502231+0000","last_clean_scrub_stamp":"2023-10-06T03:55:05.502231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:32.870605+0000","scrub_duration":0.0037392129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'38","reported_seq":81,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:34.026350+0000","last_change":"2023-10-06T03:55:34.026278+0000","last_active":"2023-10-06T03:55:34.026350+0000","last_peered":"2023-10-06T03:55:34.026350+0000","last_clean":"2023-10-06T03:55:34.026350+0000","last_became_active":"2023-10-06T03:53:44.661269+0000","last_became_peered":"2023-10-06T03:53:44.661269+0000","last_unstale":"2023-10-06T03:55:34.026350+0000","last_undegraded":"2023-10-06T03:55:34.026350+0000","last_fullsized":"2023-10-06T03:55:34.026350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2023-10-06T03:55:34.026024+0000","last_clean_scrub_stamp":"2023-10-06T03:55:34.026024+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:09.390678+0000","scrub_duration":0.0046214760000000002,"objects_trimmed":0,"snaptrim_duration":0.010244603,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'6","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.456074+0000","last_change":"2023-10-06T03:55:06.455929+0000","last_active":"2023-10-06T03:55:06.456074+0000","last_peered":"2023-10-06T03:55:06.456074+0000","last_clean":"2023-10-06T03:55:06.456074+0000","last_became_active":"2023-10-06T03:53:43.661725+0000","last_became_peered":"2023-10-06T03:53:43.661725+0000","last_unstale":"2023-10-06T03:55:06.456074+0000","last_undegraded":"2023-10-06T03:55:06.456074+0000","last_fullsized":"2023-10-06T03:55:06.456074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2023-10-06T03:55:06.455659+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.455659+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:58:32.120143+0000","scrub_duration":0.0048712210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:06.162781+0000","last_change":"2023-10-06T03:55:06.162696+0000","last_active":"2023-10-06T03:55:06.162781+0000","last_peered":"2023-10-06T03:55:06.162781+0000","last_clean":"2023-10-06T03:55:06.162781+0000","last_became_active":"2023-10-06T03:53:39.491158+0000","last_became_peered":"2023-10-06T03:53:39.491158+0000","last_unstale":"2023-10-06T03:55:06.162781+0000","last_undegraded":"2023-10-06T03:55:06.162781+0000","last_fullsized":"2023-10-06T03:55:06.162781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:06.162407+0000","last_clean_scrub_stamp":"2023-10-06T03:55:06.162407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:09.832225+0000","scrub_duration":0.0036688609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'21","reported_seq":64,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179756+0000","last_change":"2023-10-06T03:55:09.636062+0000","last_active":"2023-10-06T03:55:10.179756+0000","last_peered":"2023-10-06T03:55:10.179756+0000","last_clean":"2023-10-06T03:55:10.179756+0000","last_became_active":"2023-10-06T03:53:44.650783+0000","last_became_peered":"2023-10-06T03:53:44.650783+0000","last_unstale":"2023-10-06T03:55:10.179756+0000","last_undegraded":"2023-10-06T03:55:10.179756+0000","last_fullsized":"2023-10-06T03:55:10.179756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2023-10-06T03:55:09.635780+0000","last_clean_scrub_stamp":"2023-10-06T03:55:09.635780+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:42.300582+0000","scrub_duration":0.0040873719999999997,"objects_trimmed":0,"snaptrim_duration":0.017171291000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"27'61","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:17.596116+0000","last_change":"2023-10-06T03:55:17.596047+0000","last_active":"2023-10-06T03:55:17.596116+0000","last_peered":"2023-10-06T03:55:17.596116+0000","last_clean":"2023-10-06T03:55:17.596116+0000","last_became_active":"2023-10-06T03:53:44.659270+0000","last_became_peered":"2023-10-06T03:53:44.659270+0000","last_unstale":"2023-10-06T03:55:17.596116+0000","last_undegraded":"2023-10-06T03:55:17.596116+0000","last_fullsized":"2023-10-06T03:55:17.596116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'61","last_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_deep_scrub":"27'61","last_deep_scrub_stamp":"2023-10-06T03:55:17.595793+0000","last_clean_scrub_stamp":"2023-10-06T03:55:17.595793+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:24.513035+0000","scrub_duration":0.0039416820000000002,"objects_trimmed":0,"snaptrim_duration":0.016769477000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"30'135","reported_seq":161,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:25.626677+0000","last_change":"2023-10-06T03:55:25.626637+0000","last_active":"2023-10-06T03:55:25.626677+0000","last_peered":"2023-10-06T03:55:25.626677+0000","last_clean":"2023-10-06T03:55:25.626677+0000","last_became_active":"2023-10-06T03:53:43.654709+0000","last_became_peered":"2023-10-06T03:53:43.654709+0000","last_unstale":"2023-10-06T03:55:25.626677+0000","last_undegraded":"2023-10-06T03:55:25.626677+0000","last_fullsized":"2023-10-06T03:55:25.626677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'135","last_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_deep_scrub":"30'135","last_deep_scrub_stamp":"2023-10-06T03:55:25.626485+0000","last_clean_scrub_stamp":"2023-10-06T03:55:25.626485+0000","objects_scrubbed":4,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:30.920225+0000","scrub_duration":0.013822174,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473587,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'36","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:46.516192+0000","last_change":"2023-10-06T03:55:46.516067+0000","last_active":"2023-10-06T03:55:46.516192+0000","last_peered":"2023-10-06T03:55:46.516192+0000","last_clean":"2023-10-06T03:55:46.516192+0000","last_became_active":"2023-10-06T03:53:44.671670+0000","last_became_peered":"2023-10-06T03:53:44.671670+0000","last_unstale":"2023-10-06T03:55:46.516192+0000","last_undegraded":"2023-10-06T03:55:46.516192+0000","last_fullsized":"2023-10-06T03:55:46.516192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2023-10-06T03:55:46.515759+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2023-10-06T03:55:46.515759+0000","last_clean_scrub_stamp":"2023-10-06T03:55:46.515759+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:11.771647+0000","scrub_duration":0.0041334450000000003,"objects_trimmed":0,"snaptrim_duration":0.010103025,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"30'16","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:39.730215+0000","last_change":"2023-10-06T03:55:39.730095+0000","last_active":"2023-10-06T03:55:39.730215+0000","last_peered":"2023-10-06T03:55:39.730215+0000","last_clean":"2023-10-06T03:55:39.730215+0000","last_became_active":"2023-10-06T03:53:43.668658+0000","last_became_peered":"2023-10-06T03:53:43.668658+0000","last_unstale":"2023-10-06T03:55:39.730215+0000","last_undegraded":"2023-10-06T03:55:39.730215+0000","last_fullsized":"2023-10-06T03:55:39.730215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2023-10-06T03:55:39.729838+0000","last_clean_scrub_stamp":"2023-10-06T03:55:39.729838+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:12:47.759273+0000","scrub_duration":0.0091261050000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.345078+0000","last_change":"2023-10-06T03:55:07.344971+0000","last_active":"2023-10-06T03:55:07.345078+0000","last_peered":"2023-10-06T03:55:07.345078+0000","last_clean":"2023-10-06T03:55:07.345078+0000","last_became_active":"2023-10-06T03:53:43.654925+0000","last_became_peered":"2023-10-06T03:53:43.654925+0000","last_unstale":"2023-10-06T03:55:07.345078+0000","last_undegraded":"2023-10-06T03:55:07.345078+0000","last_fullsized":"2023-10-06T03:55:07.345078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:07.344686+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.344686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:40:31.239949+0000","scrub_duration":0.004290271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"27'26","reported_seq":69,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:54.242941+0000","last_change":"2023-10-06T03:55:54.242799+0000","last_active":"2023-10-06T03:55:54.242941+0000","last_peered":"2023-10-06T03:55:54.242941+0000","last_clean":"2023-10-06T03:55:54.242941+0000","last_became_active":"2023-10-06T03:53:44.662831+0000","last_became_peered":"2023-10-06T03:53:44.662831+0000","last_unstale":"2023-10-06T03:55:54.242941+0000","last_undegraded":"2023-10-06T03:55:54.242941+0000","last_fullsized":"2023-10-06T03:55:54.242941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2023-10-06T03:55:54.242518+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2023-10-06T03:55:54.242518+0000","last_clean_scrub_stamp":"2023-10-06T03:55:54.242518+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:38.139724+0000","scrub_duration":0.0044822819999999998,"objects_trimmed":0,"snaptrim_duration":0.010254809,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"27'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:20.461561+0000","last_change":"2023-10-06T03:55:20.461433+0000","last_active":"2023-10-06T03:55:20.461561+0000","last_peered":"2023-10-06T03:55:20.461561+0000","last_clean":"2023-10-06T03:55:20.461561+0000","last_became_active":"2023-10-06T03:53:43.654843+0000","last_became_peered":"2023-10-06T03:53:43.654843+0000","last_unstale":"2023-10-06T03:55:20.461561+0000","last_undegraded":"2023-10-06T03:55:20.461561+0000","last_fullsized":"2023-10-06T03:55:20.461561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2023-10-06T03:55:20.461129+0000","last_clean_scrub_stamp":"2023-10-06T03:55:20.461129+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:27.378371+0000","scrub_duration":0.0050521910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'27","reported_seq":70,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:00.210619+0000","last_change":"2023-10-06T03:56:00.210548+0000","last_active":"2023-10-06T03:56:00.210619+0000","last_peered":"2023-10-06T03:56:00.210619+0000","last_clean":"2023-10-06T03:56:00.210619+0000","last_became_active":"2023-10-06T03:53:44.665765+0000","last_became_peered":"2023-10-06T03:53:44.665765+0000","last_unstale":"2023-10-06T03:56:00.210619+0000","last_undegraded":"2023-10-06T03:56:00.210619+0000","last_fullsized":"2023-10-06T03:56:00.210619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2023-10-06T03:56:00.210252+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2023-10-06T03:56:00.210252+0000","last_clean_scrub_stamp":"2023-10-06T03:56:00.210252+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:27:53.470250+0000","scrub_duration":0.0038805200000000001,"objects_trimmed":0,"snaptrim_duration":0.010824848999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'29","reported_seq":72,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.316781+0000","last_change":"2023-10-06T03:55:22.316719+0000","last_active":"2023-10-06T03:55:22.316781+0000","last_peered":"2023-10-06T03:55:22.316781+0000","last_clean":"2023-10-06T03:55:22.316781+0000","last_became_active":"2023-10-06T03:53:44.657922+0000","last_became_peered":"2023-10-06T03:53:44.657922+0000","last_unstale":"2023-10-06T03:55:22.316781+0000","last_undegraded":"2023-10-06T03:55:22.316781+0000","last_fullsized":"2023-10-06T03:55:22.316781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2023-10-06T03:55:22.316458+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.316458+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:19.762745+0000","scrub_duration":0.0038390270000000001,"objects_trimmed":0,"snaptrim_duration":0.0072167000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:32.023492+0000","last_change":"2023-10-06T03:55:32.023425+0000","last_active":"2023-10-06T03:55:32.023492+0000","last_peered":"2023-10-06T03:55:32.023492+0000","last_clean":"2023-10-06T03:55:32.023492+0000","last_became_active":"2023-10-06T03:53:43.666622+0000","last_became_peered":"2023-10-06T03:53:43.666622+0000","last_unstale":"2023-10-06T03:55:32.023492+0000","last_undegraded":"2023-10-06T03:55:32.023492+0000","last_fullsized":"2023-10-06T03:55:32.023492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:55:32.023106+0000","last_clean_scrub_stamp":"2023-10-06T03:55:32.023106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:18.972045+0000","scrub_duration":0.0039914340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'20","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:50.385334+0000","last_change":"2023-10-06T03:55:50.385288+0000","last_active":"2023-10-06T03:55:50.385334+0000","last_peered":"2023-10-06T03:55:50.385334+0000","last_clean":"2023-10-06T03:55:50.385334+0000","last_became_active":"2023-10-06T03:53:44.663326+0000","last_became_peered":"2023-10-06T03:53:44.663326+0000","last_unstale":"2023-10-06T03:55:50.385334+0000","last_undegraded":"2023-10-06T03:55:50.385334+0000","last_fullsized":"2023-10-06T03:55:50.385334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2023-10-06T03:55:50.385136+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2023-10-06T03:55:50.385136+0000","last_clean_scrub_stamp":"2023-10-06T03:55:50.385136+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:34.282342+0000","scrub_duration":0.003439274,"objects_trimmed":0,"snaptrim_duration":0.0096240690000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:22.565981+0000","last_change":"2023-10-06T03:55:22.565888+0000","last_active":"2023-10-06T03:55:22.565981+0000","last_peered":"2023-10-06T03:55:22.565981+0000","last_clean":"2023-10-06T03:55:22.565981+0000","last_became_active":"2023-10-06T03:53:43.668364+0000","last_became_peered":"2023-10-06T03:53:43.668364+0000","last_unstale":"2023-10-06T03:55:22.565981+0000","last_undegraded":"2023-10-06T03:55:22.565981+0000","last_fullsized":"2023-10-06T03:55:22.565981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:22.565609+0000","last_clean_scrub_stamp":"2023-10-06T03:55:22.565609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:55.230411+0000","scrub_duration":0.0038460399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'52","reported_seq":95,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:53.231119+0000","last_change":"2023-10-06T03:55:53.231042+0000","last_active":"2023-10-06T03:55:53.231119+0000","last_peered":"2023-10-06T03:55:53.231119+0000","last_clean":"2023-10-06T03:55:53.231119+0000","last_became_active":"2023-10-06T03:53:44.660779+0000","last_became_peered":"2023-10-06T03:53:44.660779+0000","last_unstale":"2023-10-06T03:55:53.231119+0000","last_undegraded":"2023-10-06T03:55:53.231119+0000","last_fullsized":"2023-10-06T03:55:53.231119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2023-10-06T03:55:53.230784+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2023-10-06T03:55:53.230784+0000","last_clean_scrub_stamp":"2023-10-06T03:55:53.230784+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:01.015692+0000","scrub_duration":0.0044376190000000003,"objects_trimmed":0,"snaptrim_duration":0.010425553000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:26.625168+0000","last_change":"2023-10-06T03:55:26.625028+0000","last_active":"2023-10-06T03:55:26.625168+0000","last_peered":"2023-10-06T03:55:26.625168+0000","last_clean":"2023-10-06T03:55:26.625168+0000","last_became_active":"2023-10-06T03:53:43.656031+0000","last_became_peered":"2023-10-06T03:53:43.656031+0000","last_unstale":"2023-10-06T03:55:26.625168+0000","last_undegraded":"2023-10-06T03:55:26.625168+0000","last_fullsized":"2023-10-06T03:55:26.625168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-10-06T03:55:26.624756+0000","last_clean_scrub_stamp":"2023-10-06T03:55:26.624756+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:01.989410+0000","scrub_duration":0.0039742479999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'32","reported_seq":75,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:10.179026+0000","last_change":"2023-10-06T03:55:04.752729+0000","last_active":"2023-10-06T03:55:10.179026+0000","last_peered":"2023-10-06T03:55:10.179026+0000","last_clean":"2023-10-06T03:55:10.179026+0000","last_became_active":"2023-10-06T03:53:44.665097+0000","last_became_peered":"2023-10-06T03:53:44.665097+0000","last_unstale":"2023-10-06T03:55:10.179026+0000","last_undegraded":"2023-10-06T03:55:10.179026+0000","last_fullsized":"2023-10-06T03:55:10.179026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2023-10-06T03:55:04.752482+0000","last_clean_scrub_stamp":"2023-10-06T03:55:04.752482+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:43.597358+0000","scrub_duration":0.0040964770000000003,"objects_trimmed":0,"snaptrim_duration":0.0068794099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T03:55:07.470473+0000","last_change":"2023-10-06T03:55:07.470370+0000","last_active":"2023-10-06T03:55:07.470473+0000","last_peered":"2023-10-06T03:55:07.470473+0000","last_clean":"2023-10-06T03:55:07.470473+0000","last_became_active":"2023-10-06T03:53:43.655911+0000","last_became_peered":"2023-10-06T03:53:43.655911+0000","last_unstale":"2023-10-06T03:55:07.470473+0000","last_undegraded":"2023-10-06T03:55:07.470473+0000","last_fullsized":"2023-10-06T03:55:07.470473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:07.470104+0000","last_clean_scrub_stamp":"2023-10-06T03:55:07.470104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:36:04.916392+0000","scrub_duration":0.0045462330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'33","reported_seq":79,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:56:05.922463+0000","last_change":"2023-10-06T03:56:05.922357+0000","last_active":"2023-10-06T03:56:05.922463+0000","last_peered":"2023-10-06T03:56:05.922463+0000","last_clean":"2023-10-06T03:56:05.922463+0000","last_became_active":"2023-10-06T03:53:44.656941+0000","last_became_peered":"2023-10-06T03:53:44.656941+0000","last_unstale":"2023-10-06T03:56:05.922463+0000","last_undegraded":"2023-10-06T03:56:05.922463+0000","last_fullsized":"2023-10-06T03:56:05.922463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:56:05.921962+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:56:05.921962+0000","last_clean_scrub_stamp":"2023-10-06T03:56:05.921962+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:09:04.328796+0000","scrub_duration":0.004639827,"objects_trimmed":0,"snaptrim_duration":0.017320401999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"30'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:21.308283+0000","last_change":"2023-10-06T03:55:21.308191+0000","last_active":"2023-10-06T03:55:21.308283+0000","last_peered":"2023-10-06T03:55:21.308283+0000","last_clean":"2023-10-06T03:55:21.308283+0000","last_became_active":"2023-10-06T03:53:43.650970+0000","last_became_peered":"2023-10-06T03:53:43.650970+0000","last_unstale":"2023-10-06T03:55:21.308283+0000","last_undegraded":"2023-10-06T03:55:21.308283+0000","last_fullsized":"2023-10-06T03:55:21.308283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-10-06T03:55:21.307933+0000","last_clean_scrub_stamp":"2023-10-06T03:55:21.307933+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:15.544267+0000","scrub_duration":0.0067126479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'34","reported_seq":77,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:59.834167+0000","last_change":"2023-10-06T03:55:59.834052+0000","last_active":"2023-10-06T03:55:59.834167+0000","last_peered":"2023-10-06T03:55:59.834167+0000","last_clean":"2023-10-06T03:55:59.834167+0000","last_became_active":"2023-10-06T03:53:44.657258+0000","last_became_peered":"2023-10-06T03:53:44.657258+0000","last_unstale":"2023-10-06T03:55:59.834167+0000","last_undegraded":"2023-10-06T03:55:59.834167+0000","last_fullsized":"2023-10-06T03:55:59.834167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2023-10-06T03:55:59.833796+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2023-10-06T03:55:59.833796+0000","last_clean_scrub_stamp":"2023-10-06T03:55:59.833796+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:37:23.293561+0000","scrub_duration":0.0041365239999999999,"objects_trimmed":0,"snaptrim_duration":0.017171387999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"30'5","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:14.354640+0000","last_change":"2023-10-06T03:55:14.354561+0000","last_active":"2023-10-06T03:55:14.354640+0000","last_peered":"2023-10-06T03:55:14.354640+0000","last_clean":"2023-10-06T03:55:14.354640+0000","last_became_active":"2023-10-06T03:53:43.649237+0000","last_became_peered":"2023-10-06T03:53:43.649237+0000","last_unstale":"2023-10-06T03:55:14.354640+0000","last_undegraded":"2023-10-06T03:55:14.354640+0000","last_fullsized":"2023-10-06T03:55:14.354640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2023-10-06T03:55:14.354279+0000","last_clean_scrub_stamp":"2023-10-06T03:55:14.354279+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:59.917325+0000","scrub_duration":0.0068327010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'37","reported_seq":80,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.013042+0000","last_change":"2023-10-06T03:55:33.012971+0000","last_active":"2023-10-06T03:55:33.013042+0000","last_peered":"2023-10-06T03:55:33.013042+0000","last_clean":"2023-10-06T03:55:33.013042+0000","last_became_active":"2023-10-06T03:53:44.655964+0000","last_became_peered":"2023-10-06T03:53:44.655964+0000","last_unstale":"2023-10-06T03:55:33.013042+0000","last_undegraded":"2023-10-06T03:55:33.013042+0000","last_fullsized":"2023-10-06T03:55:33.013042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2023-10-06T03:55:33.012697+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.012697+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:56:38.306437+0000","scrub_duration":0.0037924479999999999,"objects_trimmed":0,"snaptrim_duration":0.0097448389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:24.905423+0000","last_change":"2023-10-06T03:55:24.905342+0000","last_active":"2023-10-06T03:55:24.905423+0000","last_peered":"2023-10-06T03:55:24.905423+0000","last_clean":"2023-10-06T03:55:24.905423+0000","last_became_active":"2023-10-06T03:53:43.649645+0000","last_became_peered":"2023-10-06T03:53:43.649645+0000","last_unstale":"2023-10-06T03:55:24.905423+0000","last_undegraded":"2023-10-06T03:55:24.905423+0000","last_fullsized":"2023-10-06T03:55:24.905423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-10-06T03:55:24.905072+0000","last_clean_scrub_stamp":"2023-10-06T03:55:24.905072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:52:31.822314+0000","scrub_duration":0.0040591780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'33","reported_seq":76,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:33.659154+0000","last_change":"2023-10-06T03:55:33.659075+0000","last_active":"2023-10-06T03:55:33.659154+0000","last_peered":"2023-10-06T03:55:33.659154+0000","last_clean":"2023-10-06T03:55:33.659154+0000","last_became_active":"2023-10-06T03:53:44.663830+0000","last_became_peered":"2023-10-06T03:53:44.663830+0000","last_unstale":"2023-10-06T03:55:33.659154+0000","last_undegraded":"2023-10-06T03:55:33.659154+0000","last_fullsized":"2023-10-06T03:55:33.659154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2023-10-06T03:55:33.658825+0000","last_clean_scrub_stamp":"2023-10-06T03:55:33.658825+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:58.914714+0000","scrub_duration":0.0039457449999999996,"objects_trimmed":0,"snaptrim_duration":0.016574254,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"30'7","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T03:55:28.469797+0000","last_change":"2023-10-06T03:55:28.469737+0000","last_active":"2023-10-06T03:55:28.469797+0000","last_peered":"2023-10-06T03:55:28.469797+0000","last_clean":"2023-10-06T03:55:28.469797+0000","last_became_active":"2023-10-06T03:53:43.655393+0000","last_became_peered":"2023-10-06T03:53:43.655393+0000","last_unstale":"2023-10-06T03:55:28.469797+0000","last_undegraded":"2023-10-06T03:55:28.469797+0000","last_fullsized":"2023-10-06T03:55:28.469797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2023-10-06T03:55:28.469538+0000","last_clean_scrub_stamp":"2023-10-06T03:55:28.469538+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:15.418477+0000","scrub_duration":0.0089670759999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2074,"ondisk_log_size":2074,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":479912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":207,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":959824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298672,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073168,"statfs":{"total":96636764160,"available":96330924032,"internally_reserved":0,"allocated":1417216,"data_stored":1193661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.60499999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.173,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.079},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.198,"5min":1.208,"15min":1.208},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.113,"15min":1.03},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":15.292999999999999,"5min":15.292999999999999,"15min":15.292999999999999},"last":1.214},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.149,"15min":1.071},"min":{"1min":0.624,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":14.829000000000001,"5min":14.829000000000001,"15min":14.829000000000001},"last":1.012}]},{"osd":2,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.71399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.206,"5min":1.714,"15min":1.714},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0089999999999999,"15min":1.0209999999999999},"min":{"1min":0.66800000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2949999999999999,"5min":1.649,"15min":1.649},"last":0.81899999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.96099999999999997,"15min":0.94999999999999996},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.194,"15min":1.1879999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":1.2809999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.1819999999999999,"15min":1.153},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":0.754},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0840000000000001,"15min":1.0880000000000001},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.2490000000000001,"15min":1.2330000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":6.3209999999999997,"5min":6.3209999999999997,"15min":6.3209999999999997},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.153,"5min":1.2609999999999999,"15min":1.2789999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.782,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.129}]},{"osd":6,"last update":"Fri Oct 6 03:55:32 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.29,"15min":1.319},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4470000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.246},{"interface":"front","average":{"1min":1.157,"5min":1.2490000000000001,"15min":1.2649999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5289999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.1819999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.874,"15min":0.88},"min":{"1min":0.624,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3280000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.044},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.81499999999999995,"15min":0.79500000000000004},"min":{"1min":0.66400000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2669999999999999,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.85999999999999999,"15min":0.84599999999999997},"min":{"1min":0.67300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2290000000000001,"5min":1.385,"15min":1.385},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.93200000000000005,"15min":0.93000000000000005},"min":{"1min":0.67500000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1759999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.83799999999999997},"min":{"1min":0.64400000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.288,"5min":1.742,"15min":1.742},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.93500000000000005,"15min":0.92500000000000004},"min":{"1min":0.66000000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2829999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.72599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.071},{"interface":"front","average":{"1min":1.056,"5min":1,"15min":0.99099999999999999},"min":{"1min":0.80800000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.2110000000000001,"5min":1.53,"15min":1.53},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0649999999999999,"15min":1.075},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.306,"5min":1.379,"15min":1.379},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.087,"15min":1.0860000000000001},"min":{"1min":0.81100000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3120000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.95299999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0680000000000001,"15min":1.077},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.236,"15min":1.242},"min":{"1min":1.048,"5min":1.024,"15min":1.024},"max":{"1min":1.3959999999999999,"5min":2.2570000000000001,"15min":2.2570000000000001},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:39 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1990000000000001,"15min":1.2070000000000001},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.591,"5min":1.98,"15min":1.98},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1719999999999999,"15min":1.179},"min":{"1min":0.91100000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.339,"5min":1.661,"15min":1.661},"last":1.0920000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301708,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070132,"statfs":{"total":96636764160,"available":96327815168,"internally_reserved":0,"allocated":331776,"data_stored":130114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.85699999999999998,"15min":0.84099999999999997},"min":{"1min":0.68899999999999995,"5min":0.499,"15min":0.499},"max":{"1min":1.151,"5min":1.224,"15min":1.224},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.90800000000000003,"15min":0.90000000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2150000000000001,"5min":1.403,"15min":1.403},"last":0.99299999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.67700000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.181,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.79500000000000004,"15min":0.77700000000000002},"min":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89200000000000002,"15min":0.90100000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1639999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.115,"5min":1.292,"15min":1.292},"last":1.046}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.97399999999999998,"15min":0.98599999999999999},"min":{"1min":0.69299999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1299999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.073,"5min":1.101,"15min":1.1060000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.234,"5min":1.724,"15min":1.724},"last":1.1919999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.97599999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.258,"5min":1.302,"15min":1.302},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.137,"15min":1.155},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.256,"5min":1.536,"15min":1.536},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.089,"15min":1.097},"min":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.2909999999999999,"5min":1.355,"15min":1.355},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.1619999999999999},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.306,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.79800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.3680000000000001,"5min":1.458,"15min":1.458},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.333,"5min":1.841,"15min":1.841},"last":0.79300000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":608688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.55500000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1579999999999999,"5min":1.234,"15min":1.234},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98799999999999999,"15min":0.99299999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.319,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.073},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.012,"15min":1.0169999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.88200000000000001,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.389,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.876},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.97699999999999998,"15min":0.96099999999999997},"min":{"1min":0.80500000000000005,"5min":0.622,"15min":0.622},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.64300000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.288,"5min":1.726,"15min":1.726},"last":1.0029999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":1.012,"15min":1.034},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.202,"5min":1.611,"15min":1.611},"last":1.032},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.034,"15min":1.0409999999999999},"min":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.3540000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.747}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.103,"15min":1.129},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4019999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.198,"15min":1.21},"min":{"1min":0.89600000000000002,"5min":0.87,"15min":0.87},"max":{"1min":1.3169999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.155,"15min":1.165},"min":{"1min":0.877,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.409,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.2609999999999999,"15min":1.272},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.4950000000000001,"5min":2.117,"15min":2.117},"last":0.80300000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":327680,"data_stored":129580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.85799999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76700000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.33900000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98399999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.68100000000000005,"15min":0.66500000000000004},"min":{"1min":0.45100000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0980000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.64700000000000002,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.1180000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.75,"15min":0.73199999999999998},"min":{"1min":0.59099999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.125,"5min":1.323,"15min":1.323},"last":0.91400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.88600000000000001,"15min":0.88100000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2390000000000001,"5min":1.272,"15min":1.272},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.65900000000000003,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.3340000000000001,"5min":1.452,"15min":1.452},"last":1.1479999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.77700000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3480000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":1.254},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0389999999999999,"15min":1.0289999999999999},"min":{"1min":0.68400000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3620000000000001,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.002}]},{"osd":6,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.052,"15min":1.0429999999999999},"min":{"1min":0.72699999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.4139999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.127},{"interface":"front","average":{"1min":1.073,"5min":1.0029999999999999,"15min":0.99099999999999999},"min":{"1min":0.64800000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3069999999999999,"5min":1.504,"15min":1.504},"last":1.204}]},{"osd":7,"last update":"Fri Oct 6 03:55:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0329999999999999,"15min":1.024},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.395,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.097,"15min":1.093},"min":{"1min":0.68799999999999994,"5min":0.626,"15min":0.626},"max":{"1min":1.462,"5min":1.788,"15min":1.788},"last":1.3080000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542181,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61399999999999999},"min":{"1min":0.47999999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.98999999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.139}]},{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.72499999999999998,"15min":0.71699999999999997},"min":{"1min":0.57799999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1739999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.312,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0289999999999999,"5min":1.216,"15min":1.216},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.68999999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.129,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.03},"min":{"1min":0.85699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.276,"5min":1.385,"15min":1.385},"last":0.90900000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0960000000000001,"15min":1.1060000000000001},"min":{"1min":0.73199999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3400000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.0620000000000001,"15min":1.0680000000000001},"min":{"1min":0.68100000000000005,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.254,"5min":1.54,"15min":1.54},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.163,"15min":1.1619999999999999},"min":{"1min":0.79400000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4710000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.88600000000000001,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4870000000000001,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.042}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1699999999999999,"15min":1.1739999999999999},"min":{"1min":0.80900000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.476,"5min":1.506,"15min":1.506},"last":1.01},{"interface":"front","average":{"1min":1.131,"5min":1.1539999999999999,"15min":1.1579999999999999},"min":{"1min":0.755,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.53,"5min":1.798,"15min":1.798},"last":0.86699999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301700,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070140,"statfs":{"total":96636764160,"available":96327823360,"internally_reserved":0,"allocated":323584,"data_stored":129490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.94499999999999995,"5min":1.337,"15min":1.337},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.76300000000000001,"15min":0.75},"min":{"1min":0.60099999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2150000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.874}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.90600000000000003,"5min":1.54,"15min":1.54},"last":1.032},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0940000000000001,"5min":1.224,"15min":1.224},"last":0.63500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.97999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.81899999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.004,"5min":1.28,"15min":1.28},"last":0.90900000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1220000000000001,"15min":1.1399999999999999},"min":{"1min":0.77900000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3120000000000001,"5min":2.456,"15min":2.456},"last":1.137},{"interface":"front","average":{"1min":1.046,"5min":1.163,"15min":1.1830000000000001},"min":{"1min":0.81799999999999995,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.3280000000000001,"5min":1.78,"15min":1.78},"last":1.214}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":1.125,"15min":1.153},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.397,"5min":1.875,"15min":1.875},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.1950000000000001,"15min":1.2030000000000001},"min":{"1min":0.80200000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.732,"5min":1.946,"15min":1.946},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.214,"15min":1.234},"min":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.3939999999999999,"5min":2.532,"15min":2.532},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.1819999999999999,"15min":1.1950000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4570000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.4039999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.75800000000000001,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.667,"5min":2.044,"15min":2.044},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1990000000000001,"15min":1.2090000000000001},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4450000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.272}]}]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302292,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069548,"statfs":{"total":96636764160,"available":96327217152,"internally_reserved":0,"allocated":929792,"data_stored":725967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.38200000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1599999999999999,"5min":1.466,"15min":1.466},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.81799999999999995,"15min":0.81000000000000005},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.385,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.79300000000000004,"15min":0.78400000000000003},"min":{"1min":0.38800000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.621},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85999999999999999,"15min":0.84399999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.964,"5min":1.964,"15min":1.964},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.097,"15min":1.107},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.353,"5min":1.595,"15min":1.595},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.006,"5min":1.0860000000000001,"15min":1.1000000000000001},"min":{"1min":0.72199999999999998,"5min":0.621,"15min":0.621},"max":{"1min":1.8049999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.004}]},{"osd":5,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.123,"15min":1.125},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.0070000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.73899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.5149999999999999,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.2230000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.774,"5min":2.2360000000000002,"15min":2.2360000000000002},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0449999999999999,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.056}]},{"osd":7,"last update":"Fri Oct 6 03:55:33 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.206,"15min":1.2110000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5740000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.101},{"interface":"front","average":{"1min":1.155,"5min":1.167,"15min":1.169},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7290000000000001,"5min":2.472,"15min":2.472},"last":1.141}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":6109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":479198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":473803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:56:26.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:56:26.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 Processor -- start 2023-10-06T03:56:26.739 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 -- start start 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 0x7f4d240b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d240b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d241457f0 0x7f4d24145c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240b1b10 con 0x7f4d241457f0 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240b0bd0 con 0x7f4d24067210 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240b5470 con 0x7f4d240b07a0 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d241457f0 0x7f4d24145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d241457f0 0x7f4d24145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32958/0 (socket says 172.21.15.57:32958) 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 -- 172.21.15.57:0/773685575 learned_addr learned my addr 172.21.15.57:0/773685575 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2259c700 1 --2- 172.21.15.57:0/773685575 >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 0x7f4d240b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.741 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d21d9b700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d240b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 -- 172.21.15.57:0/773685575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 msgr2=0x7f4d240b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d240b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 -- 172.21.15.57:0/773685575 >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 msgr2=0x7f4d240b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/773685575 >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 0x7f4d240b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d22d9d700 1 -- 172.21.15.57:0/773685575 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240b10a0 con 0x7f4d241457f0 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.733+0000 7f4d2259c700 1 --2- 172.21.15.57:0/773685575 >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 0x7f4d240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:56:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24145c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d240680f0 tx=0x7f4d1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d94c7140f250d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2159a700 1 -- 172.21.15.57:0/773685575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00e070 con 0x7f4d241457f0 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2159a700 1 -- 172.21.15.57:0/773685575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00ba30 con 0x7f4d241457f0 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2159a700 1 -- 172.21.15.57:0/773685575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0092e0 con 0x7f4d241457f0 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- 172.21.15.57:0/773685575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 msgr2=0x7f4d24145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24145c40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d240680f0 tx=0x7f4d1c009840 comp rx=0 tx=0).stop 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- 172.21.15.57:0/773685575 shutdown_connections 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24145c40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- 172.21.15.57:0/773685575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d240b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- 172.21.15.57:0/773685575 >> v2:172.21.15.105:3300/0 conn(0x7f4d24067210 0x7f4d240b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- 172.21.15.57:0/773685575 >> 172.21.15.57:0/773685575 conn(0x7f4d240b8bb0 msgr2=0x7f4d240b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- 172.21.15.57:0/773685575 shutdown_connections 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- 172.21.15.57:0/773685575 wait complete. 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 Processor -- start 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- start start 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24067210 0x7f4d2413f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d241559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2413fed0 con 0x7f4d241457f0 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d24155540 con 0x7f4d24067210 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2359e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240acc30 con 0x7f4d240b07a0 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d2259c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24067210 0x7f4d2413f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d21d9b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d241559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32964/0 (socket says 172.21.15.57:32964) 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 -- 172.21.15.57:0/3477788189 learned_addr learned my addr 172.21.15.57:0/3477788189 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 -- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 msgr2=0x7f4d241559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d241559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 -- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24067210 msgr2=0x7f4d2413f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24067210 0x7f4d2413f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.737+0000 7f4d22d9d700 1 -- 172.21.15.57:0/3477788189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c009ae0 con 0x7f4d241457f0 2023-10-06T03:56:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d22d9d700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d240b99e0 tx=0x7f4d1c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0092e0 con 0x7f4d241457f0 2023-10-06T03:56:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0070a0 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c026470 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240ada30 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d240add10 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f4d1c023070 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d241556f0 con 0x7f4d241457f0 2023-10-06T03:56:26.749 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.741+0000 7f4d1a7fc700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 0x7f4d04062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.745+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f4d1c07ea00 con 0x7f4d241457f0 2023-10-06T03:56:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.745+0000 7f4d2259c700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 0x7f4d04062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.745+0000 7f4d2259c700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 0x7f4d04062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d2413f850 tx=0x7f4d0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:26.759 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.753+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4d241556f0 con 0x7f4d241457f0 2023-10-06T03:56:26.915 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.909+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4d241556f0 con 0x7f4d241457f0 2023-10-06T03:56:26.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.921+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d1c003300 con 0x7f4d241457f0 2023-10-06T03:56:26.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.921+0000 7f4d1a7fc700 1 -- 172.21.15.57:0/3477788189 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4d241556f0 con 0x7f4d241457f0 2023-10-06T03:56:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 msgr2=0x7f4d04062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 0x7f4d04062a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d2413f850 tx=0x7f4d0c008040 comp rx=0 tx=0).stop 2023-10-06T03:56:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 msgr2=0x7f4d24151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:26.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d240b99e0 tx=0x7f4d1c018000 comp rx=0 tx=0).stop 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 shutdown_connections 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f4d04060550 0x7f4d04062a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d241457f0 0x7f4d24151dc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d240b07a0 0x7f4d241559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 --2- 172.21.15.57:0/3477788189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24067210 0x7f4d2413f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:26.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 >> 172.21.15.57:0/3477788189 conn(0x7f4d240b8bb0 msgr2=0x7f4d240b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 shutdown_connections 2023-10-06T03:56:26.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:26.925+0000 7f4d2359e700 1 -- 172.21.15.57:0/3477788189 wait complete. 2023-10-06T03:56:26.945 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:56:26.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:56:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 Processor -- start 2023-10-06T03:56:27.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 -- start start 2023-10-06T03:56:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d081422c0 0x7f0d08142740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0814ac50 0x7f0d0814d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d081462f0 con 0x7f0d0806ec30 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d081432b0 con 0x7f0d081422c0 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d0cacc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0806cdb0 con 0x7f0d0814ac50 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0cfeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d081422c0 0x7f0d08142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d077fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0d0806ec30 0x7f0d0806ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56038/0 (socket says 172.21.15.57:56038) 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d077fe700 1 -- 172.21.15.57:0/1987147943 learned_addr learned my addr 172.21.15.57:0/1987147943 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:56:27.053 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.045+0000 7f0d07fff700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0814ac50 0x7f0d0814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0cfeffd700 1 -- 172.21.15.57:0/1987147943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0814ac50 msgr2=0x7f0d0814d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0cfeffd700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0814ac50 0x7f0d0814d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0cfeffd700 1 -- 172.21.15.57:0/1987147943 >> v1:172.21.15.57:6789/0 conn(0x7f0d0806ec30 legacy=0x7f0d0806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0cfeffd700 1 -- 172.21.15.57:0/1987147943 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0813c940 con 0x7f0d081422c0 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0cfeffd700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d081422c0 0x7f0d08142740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00098e0 tx=0x7f0cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a890553298f026 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d06ffd700 1 -- 172.21.15.57:0/1987147943 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0009e80 con 0x7f0d081422c0 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d06ffd700 1 -- 172.21.15.57:0/1987147943 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cf000b860 con 0x7f0d081422c0 2023-10-06T03:56:27.054 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d06ffd700 1 -- 172.21.15.57:0/1987147943 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000bc00 con 0x7f0d081422c0 2023-10-06T03:56:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- 172.21.15.57:0/1987147943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d081422c0 msgr2=0x7f0d08142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d081422c0 0x7f0d08142740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00098e0 tx=0x7f0cf00091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- 172.21.15.57:0/1987147943 shutdown_connections 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0814ac50 0x7f0d0814d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/1987147943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d081422c0 0x7f0d08142740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- 172.21.15.57:0/1987147943 >> 172.21.15.57:0/1987147943 conn(0x7f0d080b1a00 msgr2=0x7f0d080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- 172.21.15.57:0/1987147943 shutdown_connections 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- 172.21.15.57:0/1987147943 wait complete. 2023-10-06T03:56:27.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 Processor -- start 2023-10-06T03:56:27.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.049+0000 7f0d0cacc700 1 -- start start 2023-10-06T03:56:27.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d081422c0 0x7f0d080aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d0814ac50 0x7f0d08144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080aca70 con 0x7f0d0806ec30 2023-10-06T03:56:27.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080aaac0 con 0x7f0d0814ac50 2023-10-06T03:56:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080acc30 con 0x7f0d081422c0 2023-10-06T03:56:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32978/0 (socket says 172.21.15.57:32978) 2023-10-06T03:56:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 -- 172.21.15.57:0/993519116 learned_addr learned my addr 172.21.15.57:0/993519116 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:27.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0cfeffd700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d081422c0 0x7f0d080aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.060 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d07fff700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d0814ac50 0x7f0d08144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 -- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d081422c0 msgr2=0x7f0d080aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d081422c0 0x7f0d080aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 -- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d0814ac50 msgr2=0x7f0d08144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.061 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d0814ac50 0x7f0d08144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 -- 172.21.15.57:0/993519116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0009420 con 0x7f0d0806ec30 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d077fe700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c590 tx=0x7f0cf8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8005b30 con 0x7f0d0806ec30 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0cf8005cb0 con 0x7f0d0806ec30 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080ad720 con 0x7f0d0806ec30 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8007340 con 0x7f0d0806ec30 2023-10-06T03:56:27.062 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d080aa670 con 0x7f0d0806ec30 2023-10-06T03:56:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.053+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0806b930 con 0x7f0d0806ec30 2023-10-06T03:56:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.057+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f0cf801b3b0 con 0x7f0d0806ec30 2023-10-06T03:56:27.063 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.057+0000 7f0cfffff700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 0x7f0ce8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.057+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0cf807bd70 con 0x7f0d0806ec30 2023-10-06T03:56:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.057+0000 7f0cfeffd700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 0x7f0ce8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.057+0000 7f0cfeffd700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 0x7f0ce8062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d080a94e0 tx=0x7f0cf00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.065+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0cf804c1b0 con 0x7f0d0806ec30 2023-10-06T03:56:27.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.261+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d08070450 con 0x7f0d0806ec30 2023-10-06T03:56:27.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.261+0000 7f0cfffff700 1 -- 172.21.15.57:0/993519116 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7f0cf8017c20 con 0x7f0d0806ec30 2023-10-06T03:56:27.267 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:56:27.267 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:56:27.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 msgr2=0x7f0ce8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 0x7f0ce8062a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d080a94e0 tx=0x7f0cf00091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 msgr2=0x7f0d080b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c590 tx=0x7f0cf8001020 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 shutdown_connections 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f0ce8060550 0x7f0ce8062a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d0814ac50 0x7f0d08144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d081422c0 0x7f0d080aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 --2- 172.21.15.57:0/993519116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d0806ec30 0x7f0d080b45a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 >> 172.21.15.57:0/993519116 conn(0x7f0d080b1a00 msgr2=0x7f0d08138660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.270 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 shutdown_connections 2023-10-06T03:56:27.271 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.265+0000 7f0d0cacc700 1 -- 172.21.15.57:0/993519116 wait complete. 2023-10-06T03:56:27.271 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:56:27.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:56:27.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.373+0000 7fa96bca8700 1 Processor -- start 2023-10-06T03:56:27.381 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- start start 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa9640b13e0 0x7fa9640ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9640a4490 con 0x7fa9640acac0 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640b0dc0 con 0x7fa9640b13e0 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640adbc0 con 0x7fa9640abc90 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.57:44736/0 (socket says 172.21.15.57:44736) 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 -- 172.21.15.57:0/3664543479 learned_addr learned my addr 172.21.15.57:0/3664543479 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969a44700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa9640b13e0 0x7fa9640ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 -- 172.21.15.57:0/3664543479 >> v2:172.21.15.105:3300/0 conn(0x7fa9640b13e0 msgr2=0x7fa9640ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 --2- 172.21.15.57:0/3664543479 >> v2:172.21.15.105:3300/0 conn(0x7fa9640b13e0 0x7fa9640ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 -- 172.21.15.57:0/3664543479 >> v1:172.21.15.105:6789/0 conn(0x7fa9640acac0 legacy=0x7fa9640af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 -- 172.21.15.57:0/3664543479 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640b0700 con 0x7fa9640abc90 2023-10-06T03:56:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa969243700 1 --2- 172.21.15.57:0/3664543479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3ec68b69c28b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa968a42700 1 -- 172.21.15.57:0/3664543479 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960009ea0 con 0x7fa9640abc90 2023-10-06T03:56:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa968a42700 1 -- 172.21.15.57:0/3664543479 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa96000b860 con 0x7fa9640abc90 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa968a42700 1 -- 172.21.15.57:0/3664543479 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000bc40 con 0x7fa9640abc90 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- 172.21.15.57:0/3664543479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 msgr2=0x7fa9640ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 --2- 172.21.15.57:0/3664543479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960009250 comp rx=0 tx=0).stop 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- 172.21.15.57:0/3664543479 shutdown_connections 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 --2- 172.21.15.57:0/3664543479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640ac580 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 --2- 172.21.15.57:0/3664543479 >> v2:172.21.15.105:3300/0 conn(0x7fa9640b13e0 0x7fa9640ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- 172.21.15.57:0/3664543479 >> 172.21.15.57:0/3664543479 conn(0x7fa964067070 msgr2=0x7fa964067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- 172.21.15.57:0/3664543479 shutdown_connections 2023-10-06T03:56:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.377+0000 7fa96bca8700 1 -- 172.21.15.57:0/3664543479 wait complete. 2023-10-06T03:56:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 Processor -- start 2023-10-06T03:56:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 -- start start 2023-10-06T03:56:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9640b13e0 0x7fa964155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa964121630 con 0x7fa9640acac0 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640ac580 con 0x7fa9640b13e0 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96bca8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa964120910 con 0x7fa9640abc90 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa969243700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa969243700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32992/0 (socket says 172.21.15.57:32992) 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa969243700 1 -- 172.21.15.57:0/2271646492 learned_addr learned my addr 172.21.15.57:0/2271646492 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa969a44700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.381+0000 7fa96a245700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9640b13e0 0x7fa964155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 -- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 msgr2=0x7fa9640aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 -- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9640b13e0 msgr2=0x7fa964155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9640b13e0 0x7fa964155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 -- 172.21.15.57:0/2271646492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600094f0 con 0x7fa9640acac0 2023-10-06T03:56:27.391 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa969243700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa9600090b0 tx=0x7fa960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96001ab60 con 0x7fa9640acac0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa96001acc0 con 0x7fa9640acac0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9640a9e70 con 0x7fa9640acac0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600266c0 con 0x7fa9640acac0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9640ab410 con 0x7fa9640acac0 2023-10-06T03:56:27.392 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9640ab5b0 con 0x7fa9640acac0 2023-10-06T03:56:27.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.385+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7fa960026a70 con 0x7fa9640acac0 2023-10-06T03:56:27.393 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.389+0000 7fa959ffb700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 0x7fa948062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.389+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa96007e060 con 0x7fa9640acac0 2023-10-06T03:56:27.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.389+0000 7fa969a44700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 0x7fa948062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.394 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.389+0000 7fa969a44700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 0x7fa948062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa954009db0 tx=0x7fa9540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.397+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa9600adbe0 con 0x7fa9640acac0 2023-10-06T03:56:27.603 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.597+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9640ab410 con 0x7fa9640acac0 2023-10-06T03:56:27.604 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.597+0000 7fa959ffb700 1 -- 172.21.15.57:0/2271646492 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3082 (secure 0 0 0) 0x7fa9640ab410 con 0x7fa9640acac0 2023-10-06T03:56:27.604 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:56:27.604 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/496169584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":496169584},{"type":"v1","addr":"172.21.15.57:6833","nonce":496169584}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:53:44.000300+0000","modified":"2023-10-06T03:53:47.159976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":34133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34133":{"gid":34133,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2027616700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2027616700},{"type":"v1","addr":"172.21.15.105:6835","nonce":2027616700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:56:27.606 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 msgr2=0x7fa948062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 0x7fa948062a00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa954009db0 tx=0x7fa9540091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 msgr2=0x7fa964155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa9600090b0 tx=0x7fa960009250 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 shutdown_connections 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7fa948060550 0x7fa948062a00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9640b13e0 0x7fa964155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640acac0 0x7fa964155620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 --2- 172.21.15.57:0/2271646492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9640abc90 0x7fa9640aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 >> 172.21.15.57:0/2271646492 conn(0x7fa964067070 msgr2=0x7fa964148420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.607 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 shutdown_connections 2023-10-06T03:56:27.608 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.601+0000 7fa96bca8700 1 -- 172.21.15.57:0/2271646492 wait complete. 2023-10-06T03:56:27.608 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2023-10-06T03:56:27.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:56:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.717+0000 7f9812322700 1 Processor -- start 2023-10-06T03:56:27.724 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.717+0000 7f9812322700 1 -- start start 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 0x7f980c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f980c0b3490 0x7f980c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0b20e0 con 0x7f980c0b0950 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0ac360 con 0x7f980c0b3490 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1459e0 con 0x7f980c1464c0 2023-10-06T03:56:27.726 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811320700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811320700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33006/0 (socket says 172.21.15.57:33006) 2023-10-06T03:56:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9810b1f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 0x7f980c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811320700 1 -- 172.21.15.57:0/2621720922 learned_addr learned my addr 172.21.15.57:0/2621720922 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:27.727 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 --2- 172.21.15.57:0/2621720922 >> v2:172.21.15.105:3300/0 conn(0x7f980c0b3490 0x7f980c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 -- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 msgr2=0x7f980c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 0x7f980c0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 -- 172.21.15.57:0/2621720922 >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 msgr2=0x7f980c0b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 --2- 172.21.15.57:0/2621720922 >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 -- 172.21.15.57:0/2621720922 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c145cc0 con 0x7f980c0b3490 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811320700 1 --2- 172.21.15.57:0/2621720922 >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9810b1f700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 0x7f980c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:56:27.728 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9811b21700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b3490 0x7f980c0b38f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b2280 tx=0x7f9804009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27bfe961b1e706c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f97fffff700 1 -- 172.21.15.57:0/2621720922 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804016070 con 0x7f980c0b3490 2023-10-06T03:56:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f97fffff700 1 -- 172.21.15.57:0/2621720922 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f980400ba80 con 0x7f980c0b3490 2023-10-06T03:56:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f97fffff700 1 -- 172.21.15.57:0/2621720922 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400e070 con 0x7f980c0b3490 2023-10-06T03:56:27.729 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b3490 msgr2=0x7f980c0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b3490 0x7f980c0b38f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f980c0b2280 tx=0x7f9804009780 comp rx=0 tx=0).stop 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- 172.21.15.57:0/2621720922 shutdown_connections 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b3490 0x7f980c0b38f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- 172.21.15.57:0/2621720922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c1464c0 0x7f980c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 --2- 172.21.15.57:0/2621720922 >> v2:172.21.15.57:3300/0 conn(0x7f980c0b0950 0x7f980c0b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- 172.21.15.57:0/2621720922 >> 172.21.15.57:0/2621720922 conn(0x7f980c068f20 msgr2=0x7f980c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.721+0000 7f9812322700 1 -- 172.21.15.57:0/2621720922 shutdown_connections 2023-10-06T03:56:27.730 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 -- 172.21.15.57:0/2621720922 wait complete. 2023-10-06T03:56:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 Processor -- start 2023-10-06T03:56:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 -- start start 2023-10-06T03:56:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b0950 0x7f980c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.732 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 0x7f980c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c143590 con 0x7f980c1464c0 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c144490 con 0x7f980c0b0950 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9812322700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c140140 con 0x7f980c0b3490 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9811b21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.733 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9811b21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33018/0 (socket says 172.21.15.57:33018) 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9811b21700 1 -- 172.21.15.57:0/847815954 learned_addr learned my addr 172.21.15.57:0/847815954 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9811320700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b0950 0x7f980c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 0x7f980c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 -- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b0950 msgr2=0x7f980c1424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b0950 0x7f980c1424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.734 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 -- 172.21.15.57:0/847815954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 msgr2=0x7f980c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 -- 172.21.15.57:0/847815954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094f0 con 0x7f980c0b3490 2023-10-06T03:56:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9811b21700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:56:27.735 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.725+0000 7f9810b1f700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 0x7f980c155840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f980800ecb0 tx=0x7f98080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.736 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800c850 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9808009420 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f980800c9b0 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9804009a20 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800cd30 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c144640 con 0x7f980c0b3490 2023-10-06T03:56:27.737 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f9808013680 con 0x7f980c0b3490 2023-10-06T03:56:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 0x7f97f0062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f980807d300 con 0x7f980c0b3490 2023-10-06T03:56:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.729+0000 7f9811320700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 0x7f97f0062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:27.738 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.733+0000 7f9811320700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 0x7f97f0062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f980c04bfe0 tx=0x7f9800009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:27.746 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.741+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f980804d7c0 con 0x7f980c0b3490 2023-10-06T03:56:27.912 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.905+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980c144640 con 0x7f980c0b3490 2023-10-06T03:56:27.914 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.909+0000 7f97fd7fa700 1 -- 172.21.15.57:0/847815954 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f980c144640 con 0x7f980c0b3490 2023-10-06T03:56:27.914 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-10-06T03:56:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":30,"fsid":"366944c0-d2dc-4741-a456-286f74205a0c","created":"2023-10-06T03:53:20.434008+0000","modified":"2023-10-06T03:55:10.169374+0000","last_up_change":"2023-10-06T03:53:31.125904+0000","last_in_change":"2023-10-06T03:53:22.614024+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:53:32.687516+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:53:38.405877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:53:42.316403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:53:42.989663+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a1971618-a85d-4e90-bcf4-a40e7b26c1a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":33351},{"type":"v1","addr":"172.21.15.57:6817","nonce":33351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6819","nonce":33351},{"type":"v1","addr":"172.21.15.57:6821","nonce":33351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":33351},{"type":"v1","addr":"172.21.15.57:6828","nonce":33351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":33351},{"type":"v1","addr":"172.21.15.57:6824","nonce":33351}]},"public_addr":"172.21.15.57:6817/33351","cluster_addr":"172.21.15.57:6821/33351","heartbeat_back_addr":"172.21.15.57:6828/33351","heartbeat_front_addr":"172.21.15.57:6824/33351","state":["exists","up"]},{"osd":1,"uuid":"ba8d4308-ce7c-4f0e-b1a1-88f9764e5819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":33352},{"type":"v1","addr":"172.21.15.57:6820","nonce":33352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6823","nonce":33352},{"type":"v1","addr":"172.21.15.57:6825","nonce":33352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":33352},{"type":"v1","addr":"172.21.15.57:6831","nonce":33352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6827","nonce":33352},{"type":"v1","addr":"172.21.15.57:6829","nonce":33352}]},"public_addr":"172.21.15.57:6820/33352","cluster_addr":"172.21.15.57:6825/33352","heartbeat_back_addr":"172.21.15.57:6831/33352","heartbeat_front_addr":"172.21.15.57:6829/33352","state":["exists","up"]},{"osd":2,"uuid":"a7670c23-0f37-4d78-a44a-645b23a963bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":33347},{"type":"v1","addr":"172.21.15.57:6809","nonce":33347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":33347},{"type":"v1","addr":"172.21.15.57:6811","nonce":33347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":33347},{"type":"v1","addr":"172.21.15.57:6815","nonce":33347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":33347},{"type":"v1","addr":"172.21.15.57:6813","nonce":33347}]},"public_addr":"172.21.15.57:6809/33347","cluster_addr":"172.21.15.57:6811/33347","heartbeat_back_addr":"172.21.15.57:6815/33347","heartbeat_front_addr":"172.21.15.57:6813/33347","state":["exists","up"]},{"osd":3,"uuid":"f222cd48-36bc-4186-8013-deaae218e33c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":33348},{"type":"v1","addr":"172.21.15.57:6801","nonce":33348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":33348},{"type":"v1","addr":"172.21.15.57:6803","nonce":33348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":33348},{"type":"v1","addr":"172.21.15.57:6807","nonce":33348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":33348},{"type":"v1","addr":"172.21.15.57:6805","nonce":33348}]},"public_addr":"172.21.15.57:6801/33348","cluster_addr":"172.21.15.57:6803/33348","heartbeat_back_addr":"172.21.15.57:6807/33348","heartbeat_front_addr":"172.21.15.57:6805/33348","state":["exists","up"]},{"osd":4,"uuid":"d8f7fb55-f4fe-4554-a643-251915fb300e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":33626},{"type":"v1","addr":"172.21.15.105:6806","nonce":33626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":33626},{"type":"v1","addr":"172.21.15.105:6810","nonce":33626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":33626},{"type":"v1","addr":"172.21.15.105:6815","nonce":33626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":33626},{"type":"v1","addr":"172.21.15.105:6813","nonce":33626}]},"public_addr":"172.21.15.105:6806/33626","cluster_addr":"172.21.15.105:6810/33626","heartbeat_back_addr":"172.21.15.105:6815/33626","heartbeat_front_addr":"172.21.15.105:6813/33626","state":["exists","up"]},{"osd":5,"uuid":"14a82b3e-2874-4263-8228-c2442b95e456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":33628},{"type":"v1","addr":"172.21.15.105:6825","nonce":33628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":33628},{"type":"v1","addr":"172.21.15.105:6827","nonce":33628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":33628},{"type":"v1","addr":"172.21.15.105:6831","nonce":33628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":33628},{"type":"v1","addr":"172.21.15.105:6829","nonce":33628}]},"public_addr":"172.21.15.105:6825/33628","cluster_addr":"172.21.15.105:6827/33628","heartbeat_back_addr":"172.21.15.105:6831/33628","heartbeat_front_addr":"172.21.15.105:6829/33628","state":["exists","up"]},{"osd":6,"uuid":"3b2d5de7-16be-4748-80a6-f92a73a84853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":33625},{"type":"v1","addr":"172.21.15.105:6801","nonce":33625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":33625},{"type":"v1","addr":"172.21.15.105:6803","nonce":33625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6809","nonce":33625},{"type":"v1","addr":"172.21.15.105:6811","nonce":33625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6805","nonce":33625},{"type":"v1","addr":"172.21.15.105:6807","nonce":33625}]},"public_addr":"172.21.15.105:6801/33625","cluster_addr":"172.21.15.105:6803/33625","heartbeat_back_addr":"172.21.15.105:6811/33625","heartbeat_front_addr":"172.21.15.105:6807/33625","state":["exists","up"]},{"osd":7,"uuid":"b833428f-23d0-4319-9db7-2901dd5895ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":33627},{"type":"v1","addr":"172.21.15.105:6817","nonce":33627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":33627},{"type":"v1","addr":"172.21.15.105:6819","nonce":33627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":33627},{"type":"v1","addr":"172.21.15.105:6823","nonce":33627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":33627},{"type":"v1","addr":"172.21.15.105:6821","nonce":33627}]},"public_addr":"172.21.15.105:6817/33627","cluster_addr":"172.21.15.105:6819/33627","heartbeat_back_addr":"172.21.15.105:6823/33627","heartbeat_front_addr":"172.21.15.105:6821/33627","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.957829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.943059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.921988+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.832416+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.582486+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.203166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:27.784690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:53:28.092133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":4,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:56:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 msgr2=0x7f97f0062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 0x7f97f0062a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f980c04bfe0 tx=0x7f9800009250 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 msgr2=0x7f980c155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 0x7f980c155840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f980800ecb0 tx=0x7f98080091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 shutdown_connections 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f97f0060550 0x7f97f0062a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f980c1464c0 0x7f980c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f980c0b3490 0x7f980c155840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 --2- 172.21.15.57:0/847815954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f980c0b0950 0x7f980c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 >> 172.21.15.57:0/847815954 conn(0x7f980c068f20 msgr2=0x7f980c0b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 shutdown_connections 2023-10-06T03:56:27.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:27.913+0000 7f9812322700 1 -- 172.21.15.57:0/847815954 wait complete. 2023-10-06T03:56:27.938 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:56:28.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 Processor -- start 2023-10-06T03:56:28.047 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 -- start start 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05140b0400 0x7f05140b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 0x7f0514098550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b4770 0x7f05140b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0514099300 con 0x7f05140b0400 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0514099850 con 0x7f0514094400 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051b3cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0514097a70 con 0x7f05140b4770 2023-10-06T03:56:28.050 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051a3cb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05140b0400 0x7f05140b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051a3cb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f05140b0400 0x7f05140b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33022/0 (socket says 172.21.15.57:33022) 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051a3cb700 1 -- 172.21.15.57:0/2749676919 learned_addr learned my addr 172.21.15.57:0/2749676919 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051abcc700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b4770 0x7f05140b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f0519bca700 1 --2- 172.21.15.57:0/2749676919 >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 0x7f0514098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051a3cb700 1 -- 172.21.15.57:0/2749676919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b4770 msgr2=0x7f05140b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.041+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b4770 0x7f05140b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051a3cb700 1 -- 172.21.15.57:0/2749676919 >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 msgr2=0x7f0514098550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2749676919 >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 0x7f0514098550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051a3cb700 1 -- 172.21.15.57:0/2749676919 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514097d50 con 0x7f05140b0400 2023-10-06T03:56:28.051 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f0519bca700 1 --2- 172.21.15.57:0/2749676919 >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 0x7f0514098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:56:28.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b0400 0x7f05140b1d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0514097350 tx=0x7f0504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd7b32c570d5571 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f05193c9700 1 -- 172.21.15.57:0/2749676919 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400b640 con 0x7f05140b0400 2023-10-06T03:56:28.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f05193c9700 1 -- 172.21.15.57:0/2749676919 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f050400b7a0 con 0x7f05140b0400 2023-10-06T03:56:28.052 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f05193c9700 1 -- 172.21.15.57:0/2749676919 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400bb60 con 0x7f05140b0400 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- 172.21.15.57:0/2749676919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b0400 msgr2=0x7f05140b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b0400 0x7f05140b1d50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0514097350 tx=0x7f0504009250 comp rx=0 tx=0).stop 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- 172.21.15.57:0/2749676919 shutdown_connections 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b4770 0x7f05140b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2749676919 >> v2:172.21.15.105:3300/0 conn(0x7f0514094400 0x7f0514098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2749676919 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b0400 0x7f05140b1d50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- 172.21.15.57:0/2749676919 >> 172.21.15.57:0/2749676919 conn(0x7f051409a040 msgr2=0x7f0514068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- 172.21.15.57:0/2749676919 shutdown_connections 2023-10-06T03:56:28.055 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- 172.21.15.57:0/2749676919 wait complete. 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 Processor -- start 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.045+0000 7f051b3cd700 1 -- start start 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0514094400 0x7f05140ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b0400 0x7f0514145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514144840 con 0x7f05140b4770 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140ab160 con 0x7f0514094400 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140ab440 con 0x7f05140b0400 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33024/0 (socket says 172.21.15.57:33024) 2023-10-06T03:56:28.056 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 -- 172.21.15.57:0/2150882560 learned_addr learned my addr 172.21.15.57:0/2150882560 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0514094400 0x7f05140ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f0519bca700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b0400 0x7f0514145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 -- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b0400 msgr2=0x7f0514145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b0400 0x7f0514145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 -- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0514094400 msgr2=0x7f05140ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0514094400 0x7f05140ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 -- 172.21.15.57:0/2150882560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510009420 con 0x7f05140b4770 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051abcc700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e90 tx=0x7f050c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.057 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00cc20 con 0x7f05140b4770 2023-10-06T03:56:28.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f050c00f040 con 0x7f05140b4770 2023-10-06T03:56:28.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05040094f0 con 0x7f05140b4770 2023-10-06T03:56:28.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c014480 con 0x7f05140b4770 2023-10-06T03:56:28.058 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05141488f0 con 0x7f05140b4770 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0514149a50 con 0x7f05140b4770 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f050c0147f0 con 0x7f05140b4770 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.049+0000 7f050a7fc700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 0x7f04f8062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.053+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f050c07d690 con 0x7f05140b4770 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.053+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 0x7f04f8062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.059 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.053+0000 7f051a3cb700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 0x7f04f8062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0514097350 tx=0x7f0504009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.064 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.057+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0514149a50 con 0x7f05140b4770 2023-10-06T03:56:28.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.257+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0514149a50 con 0x7f05140b4770 2023-10-06T03:56:28.278 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.273+0000 7f050a7fc700 1 -- 172.21.15.57:0/2150882560 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0514149a50 con 0x7f05140b4770 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 msgr2=0x7f04f8062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 0x7f04f8062a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0514097350 tx=0x7f0504009250 comp rx=0 tx=0).stop 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 msgr2=0x7f0514145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e90 tx=0x7f050c00b040 comp rx=0 tx=0).stop 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 shutdown_connections 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f04f8060550 0x7f04f8062a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.282 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f05140b4770 0x7f0514145880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05140b0400 0x7f0514145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 --2- 172.21.15.57:0/2150882560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0514094400 0x7f05140ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 >> 172.21.15.57:0/2150882560 conn(0x7f051409a040 msgr2=0x7f05140b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 shutdown_connections 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.277+0000 7f051b3cd700 1 -- 172.21.15.57:0/2150882560 wait complete. 2023-10-06T03:56:28.283 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:56:28.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:56:28.312 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2023-10-06T03:56:28.404 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.397+0000 7f3bcffff700 1 Processor -- start 2023-10-06T03:56:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.397+0000 7f3bcffff700 1 -- start start 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3bd00b0440 0x7f3bd00b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bd00adb90 0x7f3bd0142560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd00aea50 con 0x7f3bd0142aa0 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd00b1f20 con 0x7f3bd00adb90 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd0142f00 con 0x7f3bd00b0440 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bd00adb90 0x7f3bd0142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3bd0142aa0 0x7f3bd00ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56042/0 (socket says 172.21.15.57:56042) 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcf7fe700 1 -- 172.21.15.57:0/1788982923 learned_addr learned my addr 172.21.15.57:0/1788982923 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:56:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bceffd700 1 --2- 172.21.15.57:0/1788982923 >> v2:172.21.15.105:3300/0 conn(0x7f3bd00b0440 0x7f3bd00b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 -- 172.21.15.57:0/1788982923 >> v2:172.21.15.105:3300/0 conn(0x7f3bd00b0440 msgr2=0x7f3bd00b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/1788982923 >> v2:172.21.15.105:3300/0 conn(0x7f3bd00b0440 0x7f3bd00b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 -- 172.21.15.57:0/1788982923 >> v1:172.21.15.57:6789/0 conn(0x7f3bd0142aa0 legacy=0x7f3bd00ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 -- 172.21.15.57:0/1788982923 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00b1860 con 0x7f3bd00adb90 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/1788982923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd0142560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3bd006a1f0 tx=0x7f3bc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b524826c0b9ec8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcdffb700 1 -- 172.21.15.57:0/1788982923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011630 con 0x7f3bd00adb90 2023-10-06T03:56:28.408 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcdffb700 1 -- 172.21.15.57:0/1788982923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3bc0011790 con 0x7f3bd00adb90 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcdffb700 1 -- 172.21.15.57:0/1788982923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011b50 con 0x7f3bd00adb90 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- 172.21.15.57:0/1788982923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 msgr2=0x7f3bd0142560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 --2- 172.21.15.57:0/1788982923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd0142560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3bd006a1f0 tx=0x7f3bc00091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- 172.21.15.57:0/1788982923 shutdown_connections 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 --2- 172.21.15.57:0/1788982923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd0142560 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 --2- 172.21.15.57:0/1788982923 >> v2:172.21.15.105:3300/0 conn(0x7f3bd00b0440 0x7f3bd00b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- 172.21.15.57:0/1788982923 >> 172.21.15.57:0/1788982923 conn(0x7f3bd0067070 msgr2=0x7f3bd0067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- 172.21.15.57:0/1788982923 shutdown_connections 2023-10-06T03:56:28.409 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.401+0000 7f3bcffff700 1 -- 172.21.15.57:0/1788982923 wait complete. 2023-10-06T03:56:28.411 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 Processor -- start 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- start start 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 0x7f3bd006c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 0x7f3bd006e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd006f3a0 con 0x7f3bd00adb90 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd013cc90 con 0x7f3bd0142aa0 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd0152690 con 0x7f3bd00b0440 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33036/0 (socket says 172.21.15.57:33036) 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 -- 172.21.15.57:0/765261841 learned_addr learned my addr 172.21.15.57:0/765261841 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:28.412 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcf7fe700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 0x7f3bd006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 0x7f3bd006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 -- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 msgr2=0x7f3bd006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 0x7f3bd006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 -- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 msgr2=0x7f3bd006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 0x7f3bd006e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 -- 172.21.15.57:0/765261841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc0009420 con 0x7f3bd00adb90 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcf7fe700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 0x7f3bd006e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 0x7f3bd006c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bceffd700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400ec80 tx=0x7f3bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400c970 con 0x7f3bd00adb90 2023-10-06T03:56:28.413 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3bc400cad0 con 0x7f3bd00adb90 2023-10-06T03:56:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0152040 con 0x7f3bd00adb90 2023-10-06T03:56:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc400ce90 con 0x7f3bd00adb90 2023-10-06T03:56:28.414 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd006cc40 con 0x7f3bd00adb90 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.405+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd0151ea0 con 0x7f3bd00adb90 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.409+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f3bc4013680 con 0x7f3bd00adb90 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.409+0000 7f3bb6ffd700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 0x7f3bbc062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.409+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f3bc407cd60 con 0x7f3bd00adb90 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.409+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 0x7f3bbc062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:28.415 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.409+0000 7f3bce7fc700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 0x7f3bbc062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009860 tx=0x7f3bc00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:28.417 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.413+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3bd0151ea0 con 0x7f3bd00adb90 2023-10-06T03:56:28.615 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:28.609+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3bd0151ea0 con 0x7f3bd00adb90 2023-10-06T03:56:29.286 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.281+0000 7f3bb6ffd700 1 -- 172.21.15.57:0/765261841 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bd0151ea0 con 0x7f3bd00adb90 2023-10-06T03:56:29.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 msgr2=0x7f3bbc062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 0x7f3bbc062a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009860 tx=0x7f3bc00091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 msgr2=0x7f3bd00b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400ec80 tx=0x7f3bc40091a0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.291 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 shutdown_connections 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f3bbc060550 0x7f3bbc062a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bd0142aa0 0x7f3bd006e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bd00b0440 0x7f3bd006c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 --2- 172.21.15.57:0/765261841 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd00adb90 0x7f3bd00b3770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 >> 172.21.15.57:0/765261841 conn(0x7f3bd0067070 msgr2=0x7f3bd00afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 shutdown_connections 2023-10-06T03:56:29.292 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.285+0000 7f3bcffff700 1 -- 172.21.15.57:0/765261841 wait complete. 2023-10-06T03:56:29.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:56:29.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.425+0000 7f84670b0700 1 Processor -- start 2023-10-06T03:56:29.432 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.425+0000 7f84670b0700 1 -- start start 2023-10-06T03:56:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f84670b0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84600b14e0 0x7f846013d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f84670b0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f846013d8c0 0x7f846014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f84670b0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8460096f40 con 0x7f84600701c0 2023-10-06T03:56:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f84670b0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8460097830 con 0x7f84600b14e0 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f84670b0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8460097c50 con 0x7f846013d8c0 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f8464e4c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f84600701c0 0x7f8460069b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56050/0 (socket says 172.21.15.57:56050) 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f8464e4c700 1 -- 172.21.15.57:0/3446708276 learned_addr learned my addr 172.21.15.57:0/3446708276 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845ffff700 1 --2- 172.21.15.57:0/3446708276 >> v2:172.21.15.57:3300/0 conn(0x7f84600b14e0 0x7f846013d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271365247 0 0) 0x7f8460096f40 con 0x7f84600701c0 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8450003570 con 0x7f84600701c0 2023-10-06T03:56:29.435 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 --2- 172.21.15.57:0/3446708276 >> v2:172.21.15.105:3300/0 conn(0x7f846013d8c0 0x7f846014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728812643 0 0) 0x7f8450003570 con 0x7f84600701c0 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 >> v2:172.21.15.105:3300/0 conn(0x7f846013d8c0 msgr2=0x7f846014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 --2- 172.21.15.57:0/3446708276 >> v2:172.21.15.105:3300/0 conn(0x7f846013d8c0 0x7f846014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 >> v2:172.21.15.57:3300/0 conn(0x7f84600b14e0 msgr2=0x7f846013d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 --2- 172.21.15.57:0/3446708276 >> v2:172.21.15.57:3300/0 conn(0x7f84600b14e0 0x7f846013d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600967d0 con 0x7f84600701c0 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 955218470 0 0) 0x7f8454001470 con 0x7f84600701c0 2023-10-06T03:56:29.438 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 >> v1:172.21.15.57:6789/0 conn(0x7f84600701c0 legacy=0x7f8460069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8450003a60 0x7f8450003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8450004810 0x7f8450004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 0x7f845000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460097830 con 0x7f84500051c0 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c0b0 con 0x7f8450004810 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c270 con 0x7f8450003a60 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845ffff700 1 --2- 172.21.15.57:0/3446708276 >> v2:172.21.15.57:3300/0 conn(0x7f84600b14e0 0x7f846013d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 0x7f845000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f8464e4c700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8450003a60 0x7f8450003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845ffff700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8450004810 0x7f8450004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 -- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8450003a60 msgr2=0x7f8450003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8450003a60 0x7f8450003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 -- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8450004810 msgr2=0x7f8450004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8450004810 0x7f8450004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 -- 172.21.15.57:0/3446708276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450003570 con 0x7f84500051c0 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f8464e4c700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8450003a60 0x7f8450003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845ffff700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8450004810 0x7f8450004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 -- 172.21.15.57:0/3446708276 reap_dead start 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f846564d700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 0x7f845000ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8458007440 tx=0x7f8458009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824a0e6d8ecc8557 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:29.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458009a40 con 0x7f84500051c0 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8458007cf0 con 0x7f84500051c0 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.429+0000 7f845f7fe700 1 -- 172.21.15.57:0/3446708276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458014670 con 0x7f84500051c0 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 msgr2=0x7f845000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 0x7f845000ba60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8458007440 tx=0x7f8458009710 comp rx=0 tx=0).stop 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- 172.21.15.57:0/3446708276 shutdown_connections 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 --2- 172.21.15.57:0/3446708276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84500051c0 0x7f845000ba60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- 172.21.15.57:0/3446708276 >> 172.21.15.57:0/3446708276 conn(0x7f84600b26d0 msgr2=0x7f84600692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- 172.21.15.57:0/3446708276 shutdown_connections 2023-10-06T03:56:29.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- 172.21.15.57:0/3446708276 wait complete. 2023-10-06T03:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 Processor -- start 2023-10-06T03:56:29.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.433+0000 7f84670b0700 1 -- start start 2023-10-06T03:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84500051c0 0x7f846006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f846013c4e0 0x7f846013c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846009ad00 con 0x7f8460098540 2023-10-06T03:56:29.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8460099c10 con 0x7f84500051c0 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846013ce90 con 0x7f846013c4e0 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f845ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f846013c4e0 0x7f846013c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f8464e4c700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84500051c0 0x7f846006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33064/0 (socket says 172.21.15.57:33064) 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 -- 172.21.15.57:0/761121757 learned_addr learned my addr 172.21.15.57:0/761121757 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 -- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f846013c4e0 msgr2=0x7f846013c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f846013c4e0 0x7f846013c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 -- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84500051c0 msgr2=0x7f846006dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84500051c0 0x7f846006dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:29.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 -- 172.21.15.57:0/761121757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846009b210 con 0x7f8460098540 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f846564d700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8458007a30 tx=0x7f8458009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458007e60 con 0x7f8460098540 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8458014bf0 con 0x7f8460098540 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8460098ef0 con 0x7f8460098540 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458016030 con 0x7f8460098540 2023-10-06T03:56:29.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84600ad3c0 con 0x7f8460098540 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.437+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846004be00 con 0x7f8460098540 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.441+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7f845801b050 con 0x7f8460098540 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.441+0000 7f845cff9700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 0x7f8444062a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.441+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f845807d770 con 0x7f8460098540 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.441+0000 7f8464e4c700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 0x7f8444062a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:29.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.441+0000 7f8464e4c700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 0x7f8444062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8454000c40 tx=0x7f8454010040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:29.454 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.449+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f845804dbf0 con 0x7f8460098540 2023-10-06T03:56:29.618 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:29.613+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8460140ee0 con 0x7f8460098540 2023-10-06T03:56:30.297 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.289+0000 7f845cff9700 1 -- 172.21.15.57:0/761121757 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8458051210 con 0x7f8460098540 2023-10-06T03:56:30.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 msgr2=0x7f8444062a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 0x7f8444062a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8454000c40 tx=0x7f8454010040 comp rx=0 tx=0).stop 2023-10-06T03:56:30.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 msgr2=0x7f84600989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.303 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8458007a30 tx=0x7f8458009710 comp rx=0 tx=0).stop 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 shutdown_connections 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7f8444060550 0x7f8444062a00 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8454000c40 tx=0x7f8454010040 comp rx=0 tx=0).stop 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8460098540 0x7f84600989b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f846013c4e0 0x7f846013c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 --2- 172.21.15.57:0/761121757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84500051c0 0x7f846006dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 >> 172.21.15.57:0/761121757 conn(0x7f84600b26d0 msgr2=0x7f8460062b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 shutdown_connections 2023-10-06T03:56:30.304 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.297+0000 7f84670b0700 1 -- 172.21.15.57:0/761121757 wait complete. 2023-10-06T03:56:30.305 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:56:30.320 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:56:30.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.429+0000 7faaaf450700 1 Processor -- start 2023-10-06T03:56:30.436 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.429+0000 7faaaf450700 1 -- start start 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 0x7faaa8142700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faaa8142c40 0x7faaa8143030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa80b1cc0 con 0x7faaa80b5a00 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa8143570 con 0x7faaa8142c40 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa80accd0 con 0x7faaa80ad870 2023-10-06T03:56:30.439 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faaa8142c40 0x7faaa8143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaae44e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faaa80b5a00 0x7faaa80ad160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56056/0 (socket says 172.21.15.57:56056) 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faaa8142c40 0x7faaa8143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33072/0 (socket says 172.21.15.57:33072) 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaae44e700 1 -- 172.21.15.57:0/2672154781 learned_addr learned my addr 172.21.15.57:0/2672154781 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaadc4d700 1 --2- 172.21.15.57:0/2672154781 >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 0x7faaa8142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 -- 172.21.15.57:0/2672154781 >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 msgr2=0x7faaa8142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 --2- 172.21.15.57:0/2672154781 >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 0x7faaa8142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 -- 172.21.15.57:0/2672154781 >> v1:172.21.15.57:6789/0 conn(0x7faaa80b5a00 legacy=0x7faaa80ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaad44c700 1 -- 172.21.15.57:0/2672154781 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020672066 0 0) 0x7faaa80b1cc0 con 0x7faaa80b5a00 2023-10-06T03:56:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 -- 172.21.15.57:0/2672154781 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80b1270 con 0x7faaa8142c40 2023-10-06T03:56:30.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaadc4d700 1 --2- 172.21.15.57:0/2672154781 >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 0x7faaa8142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:56:30.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaec4f700 1 --2- 172.21.15.57:0/2672154781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa8143030 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faaa80b6970 tx=0x7faaa0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1649968a994ebc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:30.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaad44c700 1 -- 172.21.15.57:0/2672154781 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000e070 con 0x7faaa8142c40 2023-10-06T03:56:30.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaad44c700 1 -- 172.21.15.57:0/2672154781 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faaa000bc30 con 0x7faaa8142c40 2023-10-06T03:56:30.441 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaad44c700 1 -- 172.21.15.57:0/2672154781 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0012430 con 0x7faaa8142c40 2023-10-06T03:56:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- 172.21.15.57:0/2672154781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 msgr2=0x7faaa8143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 --2- 172.21.15.57:0/2672154781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa8143030 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7faaa80b6970 tx=0x7faaa0009780 comp rx=0 tx=0).stop 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- 172.21.15.57:0/2672154781 shutdown_connections 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 --2- 172.21.15.57:0/2672154781 >> v2:172.21.15.105:3300/0 conn(0x7faaa80ad870 0x7faaa8142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 --2- 172.21.15.57:0/2672154781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa8143030 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- 172.21.15.57:0/2672154781 >> 172.21.15.57:0/2672154781 conn(0x7faaa8068180 msgr2=0x7faaa8068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- 172.21.15.57:0/2672154781 shutdown_connections 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.433+0000 7faaaf450700 1 -- 172.21.15.57:0/2672154781 wait complete. 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 Processor -- start 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- start start 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 0x7faaa8141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa80b5a00 0x7faaa8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81535f0 con 0x7faaa8142c40 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa813dd80 con 0x7faaa80ad870 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa81464f0 con 0x7faaa80b5a00 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33082/0 (socket says 172.21.15.57:33082) 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 -- 172.21.15.57:0/2116747767 learned_addr learned my addr 172.21.15.57:0/2116747767 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaadc4d700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa80b5a00 0x7faaa8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaae44e700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 0x7faaa8141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 -- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa80b5a00 msgr2=0x7faaa8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa80b5a00 0x7faaa8153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 -- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 msgr2=0x7faaa8141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 0x7faaa8141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 -- 172.21.15.57:0/2116747767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009a20 con 0x7faaa8142c40 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaae44e700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 0x7faaa8141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaec4f700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faaa8068f60 tx=0x7faaa0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0026430 con 0x7faaa8142c40 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faaa0021070 con 0x7faaa8142c40 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa8153280 con 0x7faaa8142c40 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0026820 con 0x7faaa8142c40 2023-10-06T03:56:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.437+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa8146180 con 0x7faaa8142c40 2023-10-06T03:56:30.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa81537a0 con 0x7faaa8142c40 2023-10-06T03:56:30.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 79959+0+0 (secure 0 0 0) 0x7faaa0023030 con 0x7faaa8142c40 2023-10-06T03:56:30.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faa9e7fc700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 0x7faa8c062a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:56:30.447 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5764+0+0 (secure 0 0 0) 0x7faaa007ee60 con 0x7faaa8142c40 2023-10-06T03:56:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faaae44e700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 0x7faa8c062a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:56:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.441+0000 7faaae44e700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 0x7faa8c062a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faaa40018d0 tx=0x7faaa4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:56:30.456 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.449+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7faaa81537a0 con 0x7faaa8142c40 2023-10-06T03:56:30.626 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:30.617+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faaa8153730 con 0x7faaa8142c40 2023-10-06T03:56:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.313+0000 7faa9e7fc700 1 -- 172.21.15.57:0/2116747767 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7faaa004f490 con 0x7faaa8142c40 2023-10-06T03:56:31.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 msgr2=0x7faa8c062a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:31.326 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 0x7faa8c062a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faaa40018d0 tx=0x7faaa4009040 comp rx=0 tx=0).stop 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 msgr2=0x7faaa813b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faaa8068f60 tx=0x7faaa0009780 comp rx=0 tx=0).stop 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 shutdown_connections 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:6832/33285,v1:172.21.15.105:6833/33285] conn(0x7faa8c060580 0x7faa8c062a30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa8142c40 0x7faaa813b790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faaa80b5a00 0x7faaa8153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:31.327 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 --2- 172.21.15.57:0/2116747767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa80ad870 0x7faaa8141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:56:31.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.317+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 >> 172.21.15.57:0/2116747767 conn(0x7faaa8068180 msgr2=0x7faaa80afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:56:31.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.321+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 shutdown_connections 2023-10-06T03:56:31.328 INFO:teuthology.orchestra.run.smithi057.stderr:2023-10-06T03:56:31.321+0000 7faaaf450700 1 -- 172.21.15.57:0/2116747767 wait complete. 2023-10-06T03:56:31.328 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2023-10-06T03:56:31.343 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:56:31.343 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:56:31.344 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.360 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:56:31.361 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:56:31.361 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.373 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:56:31.373 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:56:31.373 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:56:31.373 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.444 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:56:31.444 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:56:31.444 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.526 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:56:31.526 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:56:31.526 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.602 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:56:31.602 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:56:31.602 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.677 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:56:31.678 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:56:31.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.766 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:56:31.767 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:56:31.767 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.835 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:56:31.835 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:56:31.835 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.909 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:56:31.910 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:56:31.910 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:31.980 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:56:31.980 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:56:31.981 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:56:31.981 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:32.011 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:56:32.011 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:56:32.011 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:32.044 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:56:32.044 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:56:32.045 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:56:32.045 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:32.066 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:56:32.067 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:56:32.067 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:32.102 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:56:32.102 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:56:32.102 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T03:56:32.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T03:56:32.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T03:56:32.121 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:56:32.121 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:56:32.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:56:32.142 INFO:teuthology.orchestra.run.smithi057.stdout:1696564419.4620328 mon.a (mon.0) 205 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:56:32.145 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:56:32.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:56:32.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:56:32.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:56:32.187 INFO:teuthology.orchestra.run.smithi057.stdout:1696564419.4620328 mon.a (mon.0) 205 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:56:32.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:56:32.188 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:56:32.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:56:32.493 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:56:32.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:56:32.754 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:56:32.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:56:32.919 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:56:33.056 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:56:33.057 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:56:33.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:33.251 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:33.401 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:56:33.401 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:56:33.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:56:33.574 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:56:33.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:56:33.729 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:56:33.888 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:56:33.889 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/data/mon.a.tgz 2023-10-06T03:56:33.889 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-10-06T03:56:33.896 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.R6TaGFo7D0 2023-10-06T03:56:33.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.R6TaGFo7D0 2023-10-06T03:56:34.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.R6TaGFo7D0 2023-10-06T03:56:34.031 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.R6TaGFo7D0 is 267KB 2023-10-06T03:56:34.049 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.R6TaGFo7D0 2023-10-06T03:56:34.056 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/data/mon.b.tgz 2023-10-06T03:56:34.056 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2023-10-06T03:56:34.063 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.4ilDPl9UoD 2023-10-06T03:56:34.063 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4ilDPl9UoD 2023-10-06T03:56:34.153 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.4ilDPl9UoD 2023-10-06T03:56:34.176 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.4ilDPl9UoD is 357KB 2023-10-06T03:56:34.239 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.4ilDPl9UoD 2023-10-06T03:56:34.246 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/data/mon.c.tgz 2023-10-06T03:56:34.246 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2023-10-06T03:56:34.252 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.aC1DvnFAEj 2023-10-06T03:56:34.252 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aC1DvnFAEj 2023-10-06T03:56:34.337 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.aC1DvnFAEj 2023-10-06T03:56:34.361 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.aC1DvnFAEj is 355KB 2023-10-06T03:56:34.423 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.aC1DvnFAEj 2023-10-06T03:56:34.429 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:56:34.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:56:34.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:56:34.447 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:56:34.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:56:34.449 DEBUG:teuthology.orchestra.run.smithi105:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:56:34.467 INFO:teuthology.orchestra.run.smithi057.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:56:34.479 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:56:34.486 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:56:34.488 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi057/crash 2023-10-06T03:56:34.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:56:34.504 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi105/crash 2023-10-06T03:56:34.505 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:56:34.521 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:56:34.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:34.550 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:34.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:34.629 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:56:34.644 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:56:34.644 DEBUG:teuthology.orchestra.run.smithi057:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:56:34.674 DEBUG:teuthology.orchestra.run.smithi105:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:56:35.838 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:56:35.838 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi057/log 2023-10-06T03:56:35.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:56:36.318 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi105/log 2023-10-06T03:56:36.319 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:56:36.566 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:56:36.576 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:56:36.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:56:36.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:56:36.642 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:56:36.668 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:56:36.669 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:56:36.672 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================== 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout:*hv01.front.sepi 44.4.53.2 2 u 10 64 177 0.081 0.243 0.586 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 177 0.125 0.945 0.596 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 177 0.116 0.476 0.568 2023-10-06T03:56:36.690 INFO:teuthology.orchestra.run.smithi057.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:56:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2023-10-06T03:56:36.694 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2023-10-06T03:56:36.694 INFO:teuthology.orchestra.run.smithi105.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 177 0.091 1.141 1.330 2023-10-06T03:56:36.695 INFO:teuthology.orchestra.run.smithi105.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 64 177 0.095 1.831 1.434 2023-10-06T03:56:36.695 INFO:teuthology.orchestra.run.smithi105.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 177 0.118 1.370 1.646 2023-10-06T03:56:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-06T03:56:36.696 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:56:36.778 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:56:36.778 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:56:36.841 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:56:36.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:56:36.924 INFO:teuthology.task.internal:Duration was 759.507878 seconds 2023-10-06T03:56:36.925 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:56:36.997 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:56:36.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:56:37.004 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:56:37.059 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:56:37.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2023-10-06T03:56:37.060 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:56:37.080 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2023-10-06T03:56:37.080 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:56:37.097 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:56:37.097 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:56:37.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-06T03:56:37.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-06T03:56:37.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-06T03:56:37.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-06T03:56:37.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T03:56:37.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T03:56:37.127 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:56:37.186 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:56:37.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:56:37.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:56:37.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:56:37.491 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:56:37.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:56:37.512 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:56:37.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:56:37.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:56:37.705 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:56:37.718 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2023-10-06T03:56:37.722 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2023-10-06T03:56:37.752 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:56:37.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:56:37.782 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:56:37.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:56:37.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:56:37.800 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:56:37.801 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi057 2023-10-06T03:56:37.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:56:37.825 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230/remote/smithi105 2023-10-06T03:56:37.825 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:56:37.855 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:56:37.856 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:56:37.858 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:56:37.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:56:37.881 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:56:37.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:56:37.897 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:56:37.897 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:56:37.906 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:56:37.911 INFO:teuthology.orchestra.run.smithi057.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:56 /home/ubuntu/cephtest 2023-10-06T03:56:37.914 INFO:teuthology.orchestra.run.smithi105.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:56 /home/ubuntu/cephtest 2023-10-06T03:56:37.916 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:56:37.930 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:56:37.963 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:56:37.990 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-06T03:56:37.990 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:56:38.018 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:34:03.905062', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:56:38.019 DEBUG:teuthology.nuke:shortname: smithi105 2023-10-06T03:56:38.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:56:38.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 03:34:03.903335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-06T03:56:38.073 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-06T03:56:38.073 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:56:38.097 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-06T03:56:38.097 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:38.113 INFO:teuthology.orchestra.console.smithi105:Power off 2023-10-06T03:56:38.113 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:56:38.123 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T03:56:38.139 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-10-06T03:56:38.139 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:38.165 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:56:42.125 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:42.166 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:42.235 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-06T03:56:42.278 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:56:46.238 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:46.279 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:46.348 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-06T03:56:46.389 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-10-06T03:56:46.449 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-06T03:56:50.393 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:56:50.503 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-10-06T03:56:50.603 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-10-06T03:56:50.707 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} duration: 759.5078775882721 failure_reason: '"1696564419.4620328 mon.a (mon.0) 205 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:56:50.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:56:50.789 INFO:teuthology.run:FAIL